CNN Classification with Data Augmentation¶
Image Classification¶
In this project, you'll classify images from the CIFAR-10 dataset. The dataset consists of airplanes, dogs, cats, and other objects. You'll preprocess the images, then train a convolutional neural network on all the samples. The images need to be normalized and the labels need to be one-hot encoded. You'll get to apply what you learned and build a convolutional, max pooling, dropout, and fully connected layers. At the end, you'll get to see your neural network's predictions on the sample images.
Load nessecerry modules¶
In [ ]:
!pip install tqdm
In [1]:
import os, tarfile, random, pickle
from unittest.mock import MagicMock
from urllib.request import urlretrieve
from os.path import isfile, isdir
from tqdm import tqdm
import numpy as np
import tensorflow as tf
import matplotlib.pyplot as plt
from sklearn.preprocessing import LabelBinarizer
import imgaug as ia
from imgaug import augmenters as iaa
import numpy as np
import math
In [2]:
def _load_label_names():
"""
Load the label names from file
"""
return ['airplane', 'automobile', 'bird', 'cat', 'deer', 'dog', 'frog', 'horse', 'ship', 'truck']
def load_cfar10_batch(cifar10_dataset_folder_path, batch_id):
"""
Load a batch of the dataset
"""
with open(cifar10_dataset_folder_path + '/data_batch_' + str(batch_id), mode='rb') as file:
batch = pickle.load(file, encoding='latin1')
features = batch['data'].reshape((len(batch['data']), 3, 32, 32)).transpose(0, 2, 3, 1)
labels = batch['labels']
return features, labels
def load_train_batch(cifar10_dataset_folder_path, batch_id):
with open(cifar10_dataset_folder_path + '/train_batch_' + str(batch_id), mode='rb') as file:
batch = pickle.load(file)
features,labels=batch
return features, labels
def load_validation(cifar10_dataset_folder_path):
with open(cifar10_dataset_folder_path + '/validation', mode='rb') as file:
validation = pickle.load(file)
features,labels=validation
return features, labels
def load_aug_batch(cifar10_dataset_folder_path, batch_id):
with open(cifar10_dataset_folder_path + '/aug_data_batch_' + str(batch_id), mode='rb') as file:
batch = pickle.load(file)
features,labels=batch
return features, labels
def display_stats(cifar10_dataset_folder_path, batch_id, sample_id):
"""
Display Stats of the the dataset
"""
batch_ids = list(range(1, 6))
if batch_id not in batch_ids:
print('Batch Id out of Range. Possible Batch Ids: {}'.format(batch_ids))
return None
features, labels = load_cfar10_batch(cifar10_dataset_folder_path, batch_id)
if not (0 <= sample_id < len(features)):
print('{} samples in batch {}. {} is out of range.'.format(len(features), batch_id, sample_id))
return None
print('\nStats of batch {}:'.format(batch_id))
print('Samples: {}'.format(len(features)))
print('Label Counts: {}'.format(dict(zip(*np.unique(labels, return_counts=True)))))
print('First 20 Labels: {}'.format(labels[:20]))
sample_image = features[sample_id]
sample_label = labels[sample_id]
label_names = _load_label_names()
print('\nExample of Image {}:'.format(sample_id))
print('Image - Min Value: {} Max Value: {}'.format(sample_image.min(), sample_image.max()))
print('Image - Shape: {}'.format(sample_image.shape))
print('Label - Label Id: {} Name: {}'.format(sample_label, label_names[sample_label]))
plt.axis('off')
plt.imshow(sample_image)
def _preprocess_and_save(normalize, one_hot_encode, features, labels, filename):
"""
Preprocess data and save it to file
"""
features = normalize(features)
labels = one_hot_encode(labels)
pickle.dump((features, labels), open(filename, 'wb'))
def random_shuffle_split(cifar10_dataset_folder_path):
n_batches = 5
valid_features = []
valid_labels = []
for batch_i in range(1, n_batches + 1):
features, labels = load_cfar10_batch(cifar10_dataset_folder_path, batch_i)
indices = np.arange(features.shape[0])
np.random.shuffle(indices)
features = features[indices]
labels = np.array(labels)[indices].tolist()
validation_count = int(len(features) * 0.1)
# save a batch of training data
pickle.dump((features[:-validation_count], labels[:-validation_count]),
open(cifar10_dataset_folder_path+'/train_batch_' + str(batch_i), 'wb'))
# Use a portion of training batch for validation
valid_features.extend(features[-validation_count:])
valid_labels.extend(labels[-validation_count:])
# Save all validation data
pickle.dump((valid_features, valid_labels), open(cifar10_dataset_folder_path+'/validation', 'wb'))
def preprocess_and_save_data(cifar10_dataset_folder_path, normalize, one_hot_encode, aug):
"""
Preprocess Training and Validation Data
"""
n_batches = 5
valid_features = []
valid_labels = []
new_batch_i = 1
for batch_i in range(1, n_batches + 1):
features, labels = load_train_batch(cifar10_dataset_folder_path, batch_i)
if aug==True:
aug_features, aug_labels = load_aug_batch(cifar10_dataset_folder_path, batch_i)
features=np.concatenate([features,aug_features])
labels.extend(aug_labels)
indices = np.arange(features.shape[0])
np.random.shuffle(indices)
features = features[indices]
labels = np.array(labels)[indices].tolist()
l=int(len(features)/10)
for i in range(0,10):
# Prprocess and save a batch of training data
_preprocess_and_save(
normalize,
one_hot_encode,
features[i*l:(i+1)*l],
labels[i*l:(i+1)*l],
'preprocess_batch_' + str(new_batch_i) + '.p')
new_batch_i = new_batch_i + 1
valid_features, valid_labels = load_validation(cifar10_dataset_folder_path)
# Preprocess and Save all validation data
_preprocess_and_save(
normalize,
one_hot_encode,
np.array(valid_features),
np.array(valid_labels),
'preprocess_validation.p')
with open(cifar10_dataset_folder_path + '/test_batch', mode='rb') as file:
batch = pickle.load(file, encoding='latin1')
# load the test data
test_features = batch['data'].reshape((len(batch['data']), 3, 32, 32)).transpose(0, 2, 3, 1)
test_labels = batch['labels']
# Preprocess and Save all test data
_preprocess_and_save(
normalize,
one_hot_encode,
np.array(test_features),
np.array(test_labels),
'preprocess_test.p')
def batch_features_labels(features, labels, batch_size):
"""
Split features and labels into batches
"""
for start in range(0, len(features), batch_size):
end = min(start + batch_size, len(features))
yield features[start:end], labels[start:end]
def load_preprocess_training_batch(batch_id, batch_size):
"""
Load the Preprocessed Training data and return them in batches of <batch_size> or less
"""
filename = 'preprocess_batch_' + str(batch_id) + '.p'
features, labels = pickle.load(open(filename, mode='rb'))
# Return the training data in batches of size <batch_size> or less
return batch_features_labels(features, labels, batch_size)
def display_image_predictions(features, labels, predictions):
n_classes = 10
label_names = _load_label_names()
label_binarizer = LabelBinarizer()
label_binarizer.fit(range(n_classes))
label_ids = label_binarizer.inverse_transform(np.array(labels))
fig, axies = plt.subplots(nrows=4, ncols=2)
fig.tight_layout()
fig.suptitle('Softmax Predictions', fontsize=20, y=1.1)
n_predictions = 3
margin = 0.05
ind = np.arange(n_predictions)
width = (1. - 2. * margin) / n_predictions
for image_i, (feature, label_id, pred_indicies, pred_values) in enumerate(zip(features, label_ids, predictions.indices, predictions.values)):
pred_names = [label_names[pred_i] for pred_i in pred_indicies]
correct_name = label_names[label_id]
axies[image_i][0].imshow(feature)
axies[image_i][0].set_title(correct_name)
axies[image_i][0].set_axis_off()
axies[image_i][1].barh(ind + margin, pred_values[::-1], width)
axies[image_i][1].set_yticks(ind + margin)
axies[image_i][1].set_yticklabels(pred_names[::-1])
axies[image_i][1].set_xticks([0, 0.5, 1.0])
In [3]:
def _print_success_message():
print('Tests Passed')
def test_folder_path(cifar10_dataset_folder_path):
assert cifar10_dataset_folder_path is not None,\
'Cifar-10 data folder not set.'
assert cifar10_dataset_folder_path[-1] != '/',\
'The "/" shouldn\'t be added to the end of the path.'
assert os.path.exists(cifar10_dataset_folder_path),\
'Path not found.'
assert os.path.isdir(cifar10_dataset_folder_path),\
'{} is not a folder.'.format(os.path.basename(cifar10_dataset_folder_path))
train_files = [cifar10_dataset_folder_path + '/data_batch_' + str(batch_id) for batch_id in range(1, 6)]
other_files = [cifar10_dataset_folder_path + '/batches.meta', cifar10_dataset_folder_path + '/test_batch']
missing_files = [path for path in train_files + other_files if not os.path.exists(path)]
assert not missing_files,\
'Missing files in directory: {}'.format(missing_files)
print('All files found!')
def test_normalize(normalize):
test_shape = (np.random.choice(range(1000)), 32, 32, 3)
test_numbers = np.random.choice(range(256), test_shape)
normalize_out = normalize(test_numbers)
assert type(normalize_out).__module__ == np.__name__,\
'Not Numpy Object'
assert normalize_out.shape == test_shape,\
'Incorrect Shape. {} shape found'.format(normalize_out.shape)
assert normalize_out.max() <= 1 and normalize_out.min() >= 0,\
'Incorect Range. {} to {} found'.format(normalize_out.min(), normalize_out.max())
_print_success_message()
def test_one_hot_encode(one_hot_encode):
test_shape = np.random.choice(range(1000))
test_numbers = np.random.choice(range(10), test_shape)
one_hot_out = one_hot_encode(test_numbers)
assert type(one_hot_out).__module__ == np.__name__,\
'Not Numpy Object'
assert one_hot_out.shape == (test_shape, 10),\
'Incorrect Shape. {} shape found'.format(one_hot_out.shape)
n_encode_tests = 5
test_pairs = list(zip(test_numbers, one_hot_out))
test_indices = np.random.choice(len(test_numbers), n_encode_tests)
labels = [test_pairs[test_i][0] for test_i in test_indices]
enc_labels = np.array([test_pairs[test_i][1] for test_i in test_indices])
new_enc_labels = one_hot_encode(labels)
assert np.array_equal(enc_labels, new_enc_labels),\
'Encodings returned different results for the same numbers.\n' \
'For the first call it returned:\n' \
'{}\n' \
'For the second call it returned\n' \
'{}\n' \
'Make sure you save the map of labels to encodings outside of the function.'.format(enc_labels, new_enc_labels)
_print_success_message()
def test_nn_image_inputs(neural_net_image_input):
image_shape = (32, 32, 3)
nn_inputs_out_x = neural_net_image_input(image_shape)
assert nn_inputs_out_x.get_shape().as_list() == [None, image_shape[0], image_shape[1], image_shape[2]],\
'Incorrect Image Shape. Found {} shape'.format(nn_inputs_out_x.get_shape().as_list())
assert nn_inputs_out_x.op.type == 'Placeholder',\
'Incorrect Image Type. Found {} type'.format(nn_inputs_out_x.op.type)
assert nn_inputs_out_x.name == 'x:0', \
'Incorrect Name. Found {}'.format(nn_inputs_out_x.name)
print('Image Input Tests Passed.')
def test_nn_label_inputs(neural_net_label_input):
n_classes = 10
nn_inputs_out_y = neural_net_label_input(n_classes)
assert nn_inputs_out_y.get_shape().as_list() == [None, n_classes],\
'Incorrect Label Shape. Found {} shape'.format(nn_inputs_out_y.get_shape().as_list())
assert nn_inputs_out_y.op.type == 'Placeholder',\
'Incorrect Label Type. Found {} type'.format(nn_inputs_out_y.op.type)
assert nn_inputs_out_y.name == 'y:0', \
'Incorrect Name. Found {}'.format(nn_inputs_out_y.name)
print('Label Input Tests Passed.')
def test_nn_keep_prob_inputs(neural_net_keep_prob_input):
nn_inputs_out_k = neural_net_keep_prob_input()
assert nn_inputs_out_k.get_shape().ndims is None,\
'Too many dimensions found for keep prob. Found {} dimensions. It should be a scalar (0-Dimension Tensor).'.format(nn_inputs_out_k.get_shape().ndims)
assert nn_inputs_out_k.op.type == 'Placeholder',\
'Incorrect keep prob Type. Found {} type'.format(nn_inputs_out_k.op.type)
assert nn_inputs_out_k.name == 'keep_prob:0', \
'Incorrect Name. Found {}'.format(nn_inputs_out_k.name)
print('Keep Prob Tests Passed.')
def test_con_pool(conv2d_maxpool):
test_x = tf.placeholder(tf.float32, [None, 32, 32, 5])
test_num_outputs = 10
test_con_k = (2, 2)
test_con_s = (4, 4)
test_pool_k = (2, 2)
test_pool_s = (2, 2)
conv2d_maxpool_out = conv2d_maxpool(test_x, test_num_outputs, test_con_k, test_con_s, test_pool_k, test_pool_s)
assert conv2d_maxpool_out.get_shape().as_list() == [None, 4, 4, 10],\
'Incorrect Shape. Found {} shape'.format(conv2d_maxpool_out.get_shape().as_list())
_print_success_message()
def test_flatten(flatten):
test_x = tf.placeholder(tf.float32, [None, 10, 30, 6])
flat_out = flatten(test_x)
assert flat_out.get_shape().as_list() == [None, 10*30*6],\
'Incorrect Shape. Found {} shape'.format(flat_out.get_shape().as_list())
_print_success_message()
def test_fully_conn(fully_conn):
test_x = tf.placeholder(tf.float32, [None, 128])
test_num_outputs = 40
fc_out = fully_conn(test_x, test_num_outputs)
assert fc_out.get_shape().as_list() == [None, 40],\
'Incorrect Shape. Found {} shape'.format(fc_out.get_shape().as_list())
_print_success_message()
def test_output(output):
test_x = tf.placeholder(tf.float32, [None, 128])
test_num_outputs = 40
output_out = output(test_x, test_num_outputs)
assert output_out.get_shape().as_list() == [None, 40],\
'Incorrect Shape. Found {} shape'.format(output_out.get_shape().as_list())
_print_success_message()
def test_conv_net(conv_net):
test_x = tf.placeholder(tf.float32, [None, 32, 32, 3])
test_k = tf.placeholder(tf.float32)
logits_out = conv_net(test_x, test_k)
assert logits_out.get_shape().as_list() == [None, 10],\
'Incorrect Model Output. Found {}'.format(logits_out.get_shape().as_list())
print('Neural Network Built!')
def test_train_nn(train_neural_network):
mock_session = tf.Session()
test_x = np.random.rand(128, 32, 32, 3)
test_y = np.random.rand(128, 10)
test_k = np.random.rand(1)
test_optimizer = tf.train.AdamOptimizer()
mock_session.run = MagicMock()
train_neural_network(mock_session, test_optimizer, test_k, test_x, test_y)
assert mock_session.run.called, 'Session not used'
_print_success_message()
Get the Data¶
Run the following cell to download the CIFAR-10 dataset for python.
In [4]:
cifar10_dataset_folder_path = 'cifar-10-batches-py'
class DLProgress(tqdm):
last_block = 0
def hook(self, block_num=1, block_size=1, total_size=None):
self.total = total_size
self.update((block_num - self.last_block) * block_size)
self.last_block = block_num
tar_gz_path = 'cifar-10-python.tar.gz'
if not isdir(cifar10_dataset_folder_path):
if not isfile(tar_gz_path):
with DLProgress(unit='B', unit_scale=True, miniters=1, desc='CIFAR-10 Dataset') as pbar:
urlretrieve(
'https://www.cs.toronto.edu/~kriz/cifar-10-python.tar.gz',
tar_gz_path,
pbar.hook)
with tarfile.open(tar_gz_path) as tar:
tar.extractall()
tar.close()
test_folder_path(cifar10_dataset_folder_path)
All files found!
Explore the Data¶
The dataset is broken into batches to prevent your machine from running out of memory. The CIFAR-10 dataset consists of 5 batches, named data_batch_1, data_batch_2, etc.. Each batch contains the labels and images that are one of the following:
- airplane
- automobile
- bird
- cat
- deer
- dog
- frog
- horse
- ship
- truck
Understanding a dataset is part of making predictions on the data. Play around with the code cell below by changing the batch_id and sample_id. The batch_id is the id for a batch (1-5). The sample_id is the id for a image and label pair in the batch.
Ask yourself "What are all possible labels?", "What is the range of values for the image data?", "Are the labels in order or random?". Answers to questions like these will help you preprocess the data and end up with better predictions.
In [5]:
%matplotlib inline
%config InlineBackend.figure_format = 'retina'
# Explore the dataset
batch_id = 1
sample_id = 6
display_stats(cifar10_dataset_folder_path, batch_id, sample_id)
Stats of batch 1:
Samples: 10000
Label Counts: {0: 1005, 1: 974, 2: 1032, 3: 1016, 4: 999, 5: 937, 6: 1030, 7: 1001, 8: 1025, 9: 981}
First 20 Labels: [6, 9, 9, 4, 1, 1, 2, 7, 8, 3, 4, 7, 7, 2, 9, 9, 9, 3, 2, 6]
Example of Image 6:
Image - Min Value: 7 Max Value: 249
Image - Shape: (32, 32, 3)
Label - Label Id: 2 Name: bird
Random Shuffle batch data and split into train/validation¶
In [41]:
random_shuffle_split(cifar10_dataset_folder_path)
Data Augmentation¶
In [43]:
def aug_image_generation(cifar10_dataset_folder_path, number=9):
ia.seed(1)
# Example batch of images.
n_batches = 5
#batch_id = 1
for batch_id in range(1,n_batches+1):
filename=cifar10_dataset_folder_path + '/aug_data_batch_{}'.format(batch_id)
features, labels = load_train_batch(cifar10_dataset_folder_path, batch_id)
labels_aug=np.repeat(labels,number)
for sample_id in range(len(features)):
#for sample_id in range(7):
images = np.array(
[features[sample_id] for _ in range(number)],
dtype=np.uint8
)
seq = iaa.Sequential([
iaa.Fliplr(0.5), # horizontal flips
iaa.Crop(percent=(0, 0.1)), # random crops
# Small gaussian blur with random sigma between 0 and 0.5.
# But we only blur about 50% of all images.
iaa.Sometimes(0.5,
iaa.GaussianBlur(sigma=(0, 0.5))
),
# Strengthen or weaken the contrast in each image.
iaa.ContrastNormalization((0.75, 1.5)),
# Add gaussian noise.
# For 50% of all images, we sample the noise once per pixel.
# For the other 50% of all images, we sample the noise per pixel AND
# channel. This can change the color (not only brightness) of the
# pixels.
iaa.AdditiveGaussianNoise(loc=0, scale=(0.0, 0.05*255), per_channel=0.5),
# Make some images brighter and some darker.
# In 20% of all cases, we sample the multiplier once per channel,
# which can end up changing the color of the images.
iaa.Multiply((0.8, 1.2), per_channel=0.2),
# Apply affine transformations to each image.
# Scale/zoom them, translate/move them, rotate them and shear them.
iaa.Affine(
scale={"x": (0.8, 1.2), "y": (0.8, 1.2)},
translate_percent={"x": (-0.2, 0.2), "y": (-0.2, 0.2)},
rotate=(-25, 25),
shear=(-8, 8)
)
], random_order=True) # apply augmenters in random order
if sample_id==0:
images_aug=seq.augment_images(images)
else:
images_aug=np.concatenate([images_aug,seq.augment_images(images)])
print('aug batch {} shape: '.format(batch_id),images_aug.shape)
pickle.dump((images_aug, labels_aug), open(filename, 'wb'))
In [27]:
def display_aug_image(batch_id,sample_id,number=9):
filename=cifar10_dataset_folder_path + '/aug_data_batch_{}'.format(batch_id)
with open(filename, mode='rb') as file:
aug_batch = pickle.load(file)
features,labels=aug_batch
label_names = _load_label_names()
fig=plt.figure(figsize=(3, 3))
columns = 3
rows = math.ceil(number/3)
j=1
for i in range(sample_id*number,(sample_id+1)*number):
image=features[i]
fig.add_subplot(rows, columns, j)
plt.axis('off')
plt.title(label_names[labels[i]])
plt.imshow(image)
j=j+1
plt.show()
In [45]:
aug_image_generation(cifar10_dataset_folder_path, number=9)
aug batch 1 shape: (81000, 32, 32, 3) aug batch 2 shape: (81000, 32, 32, 3) aug batch 3 shape: (81000, 32, 32, 3) aug batch 4 shape: (81000, 32, 32, 3) aug batch 5 shape: (81000, 32, 32, 3)
In [69]:
display_aug_image(1,18)
In [6]:
def normalize(x):
"""
Normalize a list of sample image data in the range of 0 to 1
: x: List of image data. The image shape is (32, 32, 3)
: return: Numpy array of normalize data
"""
# TODO: Implement Function
norm = (x-x.min())/(x.max()-x.min())
return norm
"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
test_normalize(normalize)
Tests Passed
One-hot encode¶
Just like the previous code cell, you'll be implementing a function for preprocessing. This time, you'll implement the one_hot_encode function. The input, x, are a list of labels. Implement the function to return the list of labels as One-Hot encoded Numpy array. The possible values for labels are 0 to 9. The one-hot encoding function should return the same encoding for each value between each call to one_hot_encode. Make sure to save the map of encodings outside the function.
Hint: Don't reinvent the wheel.
In [7]:
def one_hot_encode(x):
"""
One hot encode a list of sample labels. Return a one-hot encoded vector for each label.
: x: List of sample Labels
: return: Numpy array of one-hot encoded labels
"""
# TODO: Implement Function
encoding = np.eye(10)[x]
return encoding
"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
test_one_hot_encode(one_hot_encode)
Tests Passed
Randomize Data¶
As you saw from exploring the data above, the order of the samples are randomized. It doesn't hurt to randomize it again, but you don't need to for this dataset.
Preprocess all the data and save it¶
Running the code cell below will preprocess all the CIFAR-10 data and save it to file. The code below also uses 10% of the training data for validation.
In [8]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
# Preprocess Training, Validation, and Testing Data
aug=True
preprocess_and_save_data(cifar10_dataset_folder_path, normalize, one_hot_encode, aug)
Out[8]:
"\nDON'T MODIFY ANYTHING IN THIS CELL\n"
Check Point¶
This is your first checkpoint. If you ever decide to come back to this notebook or have to restart the notebook, you can start from here. The preprocessed data has been saved to disk.
In [9]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
# Load the Preprocessed Validation data
valid_features, valid_labels = pickle.load(open('preprocess_validation.p', mode='rb'))
Build the network¶
For the neural network, you'll build each layer into a function. Most of the code you've seen has been outside of functions. To test your code more thoroughly, we require that you put each layer in a function. This allows us to give you better feedback and test for simple mistakes using our unittests before you submit your project.
Note: If you're finding it hard to dedicate enough time for this course each week, we've provided a small shortcut to this part of the project. In the next couple of problems, you'll have the option to use classes from the TensorFlow Layers or TensorFlow Layers (contrib) packages to build each layer, except the layers you build in the "Convolutional and Max Pooling Layer" section. TF Layers is similar to Keras's and TFLearn's abstraction to layers, so it's easy to pickup.
However, if you would like to get the most out of this course, try to solve all the problems without using anything from the TF Layers packages. You can still use classes from other packages that happen to have the same name as ones you find in TF Layers! For example, instead of using the TF Layers version of the
conv2dclass, tf.layers.conv2d, you would want to use the TF Neural Network version ofconv2d, tf.nn.conv2d.
Let's begin!
Input¶
The neural network needs to read the image data, one-hot encoded labels, and dropout keep probability. Implement the following functions
- Implement
neural_net_image_input- Return a TF Placeholder
- Set the shape using
image_shapewith batch size set toNone. - Name the TensorFlow placeholder "x" using the TensorFlow
nameparameter in the TF Placeholder.
- Implement
neural_net_label_input- Return a TF Placeholder
- Set the shape using
n_classeswith batch size set toNone. - Name the TensorFlow placeholder "y" using the TensorFlow
nameparameter in the TF Placeholder.
- Implement
neural_net_keep_prob_input- Return a TF Placeholder for dropout keep probability.
- Name the TensorFlow placeholder "keep_prob" using the TensorFlow
nameparameter in the TF Placeholder.
These names will be used at the end of the project to load your saved model.
Note: None for shapes in TensorFlow allow for a dynamic size.
In [10]:
def neural_net_input(image_shape, n_classes):
# Grouping nodes into a single name scope in the computation graph.
with tf.name_scope('inputs'):
x = tf.placeholder(tf.float32, [None] + list(image_shape), name='x')
y = tf.placeholder(tf.float32, [None ,n_classes], name='y')
keep_prob_1 = tf.placeholder(tf.float32, None, name="keep_prob_1")
keep_prob_2 = tf.placeholder(tf.float32, None, name="keep_prob_2")
learning_rate = tf.placeholder(tf.float32, None, "lr")
is_training=tf.placeholder(tf.bool, None, name='is_training')
return x, y, keep_prob_1, keep_prob_2, learning_rate, is_training
'''
def neural_net_image_input(image_shape):
"""
Return a Tensor for a batch of image input
: image_shape: Shape of the images
: return: Tensor for image input.
"""
# TODO: Implement Function
# usage : tf.placeholder(dtype, shape=None, name=None)
return tf.placeholder(tf.float32, [None] + list(image_shape), name='x')
def neural_net_label_input(n_classes):
"""
Return a Tensor for a batch of label input
: n_classes: Number of classes
: return: Tensor for label input.
"""
# TODO: Implement Function
return tf.placeholder(tf.float32, [None ,n_classes], name='y')
def neural_net_keep_prob_input():
"""
Return a Tensor for keep probability
: return: Tensor for keep probability.
"""
# TODO: Implement Function
return tf.placeholder(tf.float32, None, name="keep_prob")
'''
Out[10]:
'\ndef neural_net_image_input(image_shape):\n """\n Return a Tensor for a batch of image input\n : image_shape: Shape of the images\n : return: Tensor for image input.\n """\n # TODO: Implement Function\n # usage : tf.placeholder(dtype, shape=None, name=None)\n return tf.placeholder(tf.float32, [None] + list(image_shape), name=\'x\')\n\n\ndef neural_net_label_input(n_classes):\n """\n Return a Tensor for a batch of label input\n : n_classes: Number of classes\n : return: Tensor for label input.\n """\n # TODO: Implement Function\n return tf.placeholder(tf.float32, [None ,n_classes], name=\'y\')\n\n\ndef neural_net_keep_prob_input():\n """\n Return a Tensor for keep probability\n : return: Tensor for keep probability.\n """\n # TODO: Implement Function\n return tf.placeholder(tf.float32, None, name="keep_prob")\n'
Convolution and Max Pooling Layer¶
Convolution layers have a lot of success with images. For this code cell, you should implement the function conv2d_maxpool to apply convolution then max pooling:
- Create the weight and bias using
conv_ksize,conv_num_outputsand the shape ofx_tensor. - Apply a convolution to
x_tensorusing weight andconv_strides.- We recommend you use same padding, but you're welcome to use any padding.
- Add bias
- Add a nonlinear activation to the convolution.
- Apply Max Pooling using
pool_ksizeandpool_strides.- We recommend you use same padding, but you're welcome to use any padding.
Note: You can't use TensorFlow Layers or TensorFlow Layers (contrib) for this layer, but you can still use TensorFlow's Neural Network package. You may still use the shortcut option for all the other layers.
In [11]:
def conv2d(x_tensor, conv_num_outputs, conv_ksize, conv_strides, is_training, kernel_regularizer=None):
"""
Apply convolution then max pooling to x_tensor
:param x_tensor: TensorFlow Tensor
:param conv_num_outputs: Number of outputs for the convolutional layer
:param conv_ksize: kernal size 2-D Tuple for the convolutional layer
:param conv_strides: Stride 2-D Tuple for convolution
: return: A tensor that represents convolution of x_tensor
"""
# TODO: Implement Function
X_shape = x_tensor.get_shape().as_list()
C_kshape = list(conv_ksize + (X_shape[-1],) + (conv_num_outputs,))
# The shape of the filter weight is (height, width, input_depth, output_depth)
# The shape of the filter bias is (output_depth,)
F_W = tf.Variable(tf.truncated_normal(C_kshape, mean=0.0, stddev=np.sqrt(2.0/np.prod(C_kshape[:3]))),dtype=np.float32)
#F_W = tf.get_variable('W', shape=C_kshape, initializer=tf.contrib.layers.xavier_initializer(),dtype=np.float32)
#F_b = tf.Variable(tf.truncated_normal(conv_num_outputs, mean=0.0, stddev=0.15, dtype=np.float32))
if kernel_regularizer=='l2':
wd = 0.0001
weight_decay = tf.multiply(tf.nn.l2_loss(F_W), wd, name='weight_loss')
tf.add_to_collection('losses', weight_decay)
# The shape of the convolution stride is (batch_size, height, width, depth)
C_strides = list((1,)+conv_strides+(1,))
# The padding, either 'VALID' or 'SAME'.
padding = 'SAME'
#conv_output = tf.nn.conv2d(x_tensor, F_W, C_strides, padding) + F_b
conv_output = tf.nn.conv2d(x_tensor, F_W, C_strides, padding)
conv_output = tf.layers.batch_normalization(inputs=conv_output, training=is_training)
conv_output = tf.nn.relu(conv_output)
# Keeping track of weights and biases
tf.summary.histogram('weights', F_W)
#tf.summary.histogram('biases', F_b)
return conv_output
"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
#test_con_pool(conv2d_maxpool)
Out[11]:
"\nDON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n"
In [12]:
def pooling(x_tensor, pool_ksize, pool_strides, method='max'):
"""
Apply convolution then max pooling to x_tensor
:param x_tensor: TensorFlow Tensor
:param pool_ksize: kernal size 2-D Tuple for pool
:param pool_strides: Stride 2-D Tuple for pool
:param method: max/avg pooling, default is max
: return: A tensor that represents max pooling of x_tensor
"""
# TODO: Implement Function
# The padding, either 'VALID' or 'SAME'.
padding = 'SAME'
P_kshape = [1] + list(pool_ksize) + [1]
P_stride = [1] + list(pool_strides) + [1]
if(method=='max'):
conv_output = tf.nn.max_pool(x_tensor,P_kshape,P_stride,padding)
elif(method=='avg'):
conv_output = tf.nn.avg_pool(x_tensor,P_kshape,P_stride,padding)
return conv_output
"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
#test_con_pool(conv2d_maxpool)
Out[12]:
"\nDON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n"
Flatten Layer¶
Implement the flatten function to change the dimension of x_tensor from a 4-D tensor to a 2-D tensor. The output should be the shape (Batch Size, Flattened Image Size). Shortcut option: you can use classes from the TensorFlow Layers or TensorFlow Layers (contrib) packages for this layer. For more of a challenge, only use other TensorFlow packages.
In [13]:
def flatten(x_tensor):
"""
Flatten x_tensor to (Batch Size, Flattened Image Size)
: x_tensor: A tensor of size (Batch Size, ...), where ... are the image dimensions.
: return: A tensor of size (Batch Size, Flattened Image Size).
"""
# TODO: Implement Function
# reference : https://github.com/tensorflow/tensorflow/issues/7253
X_shape = x_tensor.get_shape().as_list()
return tf.reshape(x_tensor,[-1,np.prod(X_shape[1:])])
"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
test_flatten(flatten)
Tests Passed
Fully-Connected Layer¶
Implement the fully_conn function to apply a fully connected layer to x_tensor with the shape (Batch Size, num_outputs). Shortcut option: you can use classes from the TensorFlow Layers or TensorFlow Layers (contrib) packages for this layer. For more of a challenge, only use other TensorFlow packages.
In [14]:
def fully_conn(x_tensor, num_outputs, is_training, kernel_regularizer=None):
"""
Apply a fully connected layer to x_tensor using weight and bias
: x_tensor: A 2-D tensor where the first dimension is batch size.
: num_outputs: The number of output that the new tensor should be.
: return: A 2-D tensor where the second dimension is num_outputs.
"""
# TODO: Implement Function
X_shape = x_tensor.get_shape().as_list()
shape = list((X_shape[-1],)+(num_outputs,))
W = tf.Variable(tf.truncated_normal(shape, mean=0.0, stddev=np.sqrt(2.0/np.prod(shape[0]))),dtype=np.float32)
#W = tf.get_variable('W', shape=shape, initializer=tf.contrib.layers.xavier_initializer(),dtype=np.float32)
#b = tf.Variable(tf.truncated_normal(num_outputs ,mean=0.0, stddev=0.15, dtype=np.float32))
if kernel_regularizer=='l2':
wd = 0.0001
weight_decay = tf.multiply(tf.nn.l2_loss(W), wd, name='weight_loss')
tf.add_to_collection('losses', weight_decay)
#fc_output = tf.tensordot(x_tensor,W,axes=([1], [0]))+b
fc_output = tf.tensordot(x_tensor,W,axes=([1], [0]))
fc_output = tf.layers.batch_normalization(inputs=fc_output, training=is_training)
fc_output = tf.nn.relu(fc_output)
# Keeping track of weights and biases
tf.summary.histogram('weights', W)
#tf.summary.histogram('biases', b)
return fc_output
"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
#test_fully_conn(fully_conn)
Out[14]:
"\nDON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n"
Output Layer¶
Implement the output function to apply a fully connected layer to x_tensor with the shape (Batch Size, num_outputs). Shortcut option: you can use classes from the TensorFlow Layers or TensorFlow Layers (contrib) packages for this layer. For more of a challenge, only use other TensorFlow packages.
Note: Activation, softmax, or cross entropy should not be applied to this.
In [15]:
def output(x_tensor, num_outputs):
"""
Apply a output layer to x_tensor using weight and bias
: x_tensor: A 2-D tensor where the first dimension is batch size.
: num_outputs: The number of output that the new tensor should be.
: return: A 2-D tensor where the second dimension is num_outputs.
"""
# TODO: Implement Function
X_shape = x_tensor.get_shape().as_list()
shape = list((X_shape[-1],)+(num_outputs,))
W = tf.Variable(tf.truncated_normal(shape,0.0,0.01),dtype=np.float32)
b = tf.Variable(tf.zeros(num_outputs,dtype=np.float32))
return tf.tensordot(x_tensor,W,axes=([1], [0]))+b
"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
test_output(output)
Tests Passed
In [16]:
def global_avg_pooling(x_tensor, stride=1):
X_shape = x_tensor.get_shape().as_list()
width = X_shape[1]
height = X_shape[2]
pool_size = [width, height]
output = tf.layers.average_pooling2d(inputs=x_tensor, pool_size=pool_size, strides=stride)
output_shape = output.get_shape().as_list()
return tf.reshape(output,[-1,np.prod(output_shape[1:])])
Create Convolutional Model¶
Implement the function conv_net to create a convolutional neural network model. The function takes in a batch of images, x, and outputs logits. Use the layers you created above to create this model:
- Apply 1, 2, or 3 Convolution and Max Pool layers
- Apply a Flatten Layer
- Apply 1, 2, or 3 Fully Connected Layers
- Apply an Output Layer
- Return the output
- Apply TensorFlow's Dropout to one or more layers in the model using
keep_prob.
In [17]:
def conv_net(x, keep_prob_1, keep_prob_2, is_training=False):
"""
Create a convolutional neural network model
: x: Placeholder tensor that holds image data.
: keep_prob: Placeholder tensor that hold dropout keep probability.
: is_training: Placeholder bool that hold the flag to determine training is True or False, default is False
: return: Tensor that represents logits
"""
with tf.name_scope("CNN"):
# TODO: Apply 1, 2, or 3 Convolution and Max Pool layers
# Play around with different number of outputs, kernel size and stride
# Function Definition from Above:
# conv2d_maxpool(x_tensor, conv_num_outputs, conv_ksize, conv_strides, pool_ksize, pool_strides)
conv_num_outputs = [96, 192, 192, 10]
conv_ksize, conv_strides, pool_ksize, pool_strides = (3, 3), (1, 1), (3, 3), (2, 2)
with tf.variable_scope("conv1"):
# 96 conv: 2 max_pool: 1
conv = conv2d(x, conv_num_outputs[0], conv_ksize, conv_strides, is_training, kernel_regularizer='l2')
conv = conv2d(conv, conv_num_outputs[0], conv_ksize, conv_strides, is_training)
conv = conv2d(conv, conv_num_outputs[0], conv_ksize, conv_strides, is_training)
pool = pooling(conv, pool_ksize, pool_strides, 'max')
result = tf.nn.dropout(pool, keep_prob_1)
with tf.variable_scope("conv2"):
# 192 conv: 3 max_pool: 1
conv = conv2d(result, conv_num_outputs[1], conv_ksize, conv_strides, is_training, kernel_regularizer='l2')
conv = conv2d(conv, conv_num_outputs[1], conv_ksize, conv_strides, is_training)
conv = conv2d(conv, conv_num_outputs[1], conv_ksize, conv_strides, is_training)
pool = pooling(conv, pool_ksize, pool_strides, 'max')
result = tf.nn.dropout(pool, keep_prob_1)
with tf.variable_scope("conv3"):
# 192 conv: 3 max_pool: 0
conv = conv2d(result, conv_num_outputs[2], conv_ksize, conv_strides, is_training, kernel_regularizer='l2')
conv_ksize, conv_strides = (1, 1), (1, 1)
conv = conv2d(conv, conv_num_outputs[2], conv_ksize, conv_strides, is_training)
conv = conv2d(conv, conv_num_outputs[3], conv_ksize, conv_strides, is_training)
result = tf.nn.dropout(conv, keep_prob_1)
with tf.variable_scope("global_avg"):
o = global_avg_pooling(result)
# TODO: Apply a Flatten Layer
# Function Definition from Above:
# flatten(x_tensor)
#flattened = flatten(result)
# TODO: Apply 1, 2, or 3 Fully Connected Layers
# Play around with different number of outputs
# Function Definition from Above:
# fully_conn(x_tensor, num_outputs)
#num_outputs = [250, 150, 50]
#with tf.variable_scope("fc1"):
# fully = fully_conn(flattened, num_outputs[0], is_training, kernel_regularizer='l2')
# fc_layer = tf.nn.dropout(fully, keep_prob_2)
#with tf.variable_scope("fc2"):
# fully = fully_conn(fc_layer, num_outputs[1], is_training)
# fc_layer = tf.nn.dropout(fully, keep_prob_2)
#with tf.variable_scope("fc3"):
# fully = fully_conn(fc_layer, num_outputs[2], is_training)
# fc_layer = tf.nn.dropout(fully, keep_prob_2)
# TODO: Apply an Output Layer
# Set this to the number of classes
# Function Definition from Above:
# output(x_tensor, num_outputs)
#o = output(fc_layer, 10)
# TODO: return output
return o
Building a training op¶
In [18]:
##############################
## Build the Neural Network ##
##############################
def build_op():
# Remove previous weights, bias, inputs, etc..
tf.reset_default_graph()
# Inputs
x, y, keep_prob_1, keep_prob_2, lr, is_training = neural_net_input((32,32,3), 10)
# Model
logits = conv_net(x, keep_prob_1, keep_prob_2, is_training)
global_step = tf.Variable(0)
# Name logits Tensor, so that is can be loaded from disk after training
with tf.name_scope('logits'):
logits = tf.identity(logits, name='logits')
# Loss and Optimizer
with tf.name_scope('cost'):
cross_entropy_mean = tf.reduce_mean(tf.nn.softmax_cross_entropy_with_logits_v2(logits=logits, labels=y), name='cross_entropy_mean')
tf.add_to_collection('losses', cross_entropy_mean)
cost = tf.add_n(tf.get_collection('losses'), name='cost')
loss_summ = tf.summary.scalar('loss', cost)
#with tf.name_scope('cost'):
# cost = tf.reduce_mean(tf.nn.softmax_cross_entropy_with_logits(logits=logits, labels=y), name='cost')
#loss_summ = tf.summary.scalar('loss', cost)
with tf.name_scope('train'):
# batch normalization in tensorflow requires this update dependency
update_ops = tf.get_collection(tf.GraphKeys.UPDATE_OPS)
with tf.control_dependencies(update_ops):
optimizer = tf.train.AdamOptimizer(learning_rate=lr).minimize(cost, global_step=global_step)
#tf.add_to_collection('cost_op', cost)
#tf.add_to_collection('train_op', optimizer)
# Accuracy
with tf.name_scope('predictions'):
correct_pred = tf.equal(tf.argmax(logits, 1), tf.argmax(y, 1))
accuracy = tf.reduce_mean(tf.cast(correct_pred, tf.float32), name='accuracy')
accuracy_summ = tf.summary.scalar('accuracy', accuracy)
#summary = tf.summary.merge([loss_summ, accuracy_summ], name='summary')
#Alternatively, you can use tf.summary.merge_all()
summary = tf.summary.merge_all()
return x, y, keep_prob_1, keep_prob_2, lr, summary, optimizer, cost, accuracy, is_training
#test_conv_net(conv_net)
Train the Neural Network¶
Single Optimization¶
Implement the function train_neural_network to do a single optimization. The optimization should use optimizer to optimize in session with a feed_dict of the following:
xfor image inputyfor labelskeep_probfor keep probability for dropout
This function will be called for each batch, so tf.global_variables_initializer() has already been called.
Note: Nothing needs to be returned. This function is only optimizing the neural network.
In [19]:
def train_neural_network(session, optimizer, keep_probability, feature_batch, label_batch, learn_rate_value):
"""
Optimize the session on a batch of images and labels
: session: Current TensorFlow session
: optimizer: TensorFlow optimizer function
: keep_probability: keep probability
: feature_batch: Batch of Numpy image data
: label_batch: Batch of Numpy label data
"""
# TODO: Implement Function
session.run(optimizer, feed_dict={x:feature_batch, y:label_batch,
keep_prob_1:keep_probability[0], keep_prob_2:keep_probability[1],
lr:learn_rate_value, is_training:True})
"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
#test_train_nn(train_neural_network)
Out[19]:
"\nDON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n"
Show Stats¶
Implement the function print_stats to print loss and validation accuracy. Use the global variables valid_features and valid_labels to calculate validation accuracy. Use a keep probability of 1.0 to calculate the loss and validation accuracy.
In [20]:
def print_stats(session, feature_batch, label_batch, cost, accuracy, learn_rate_value):
"""
Print information about loss and validation accuracy
: session: Current TensorFlow session
: feature_batch: Batch of Numpy image data
: label_batch: Batch of Numpy label data
: cost: TensorFlow cost function
: accuracy: TensorFlow accuracy function
"""
# TODO: Implement Function
loss = session.run(cost, feed_dict={x:feature_batch, y:label_batch, keep_prob_1:1.0, keep_prob_2:1.0,
lr:learn_rate_value, is_training: True})
valid_acc = sess.run(accuracy, feed_dict={x: valid_features, y: valid_labels, keep_prob_1:1.0, keep_prob_2:1.0,
lr:learn_rate_value, is_training: False})
print('Loss: {:>10.4f} Validation Accuracy: {:.6f}'.format(loss, valid_acc))
return loss, valid_acc
Hyperparameters¶
Tune the following parameters:
- Set
epochsto the number of iterations until the network stops learning or start overfitting - Set
batch_sizeto the highest number that your machine has memory for. Most people set them to common sizes of memory:- 64
- 128
- 256
- ...
- Set
keep_probabilityto the probability of keeping a node using dropout
In [21]:
# TODO: Tune Parameters
epochs = 164
batch_size = 128
keep_probability = [0.5, 0.75]
learning_rate_init = 0.001
Train on a Single CIFAR-10 Batch¶
Instead of training the neural network on all the CIFAR-10 batches of data, let's use a single batch. This should save time while you iterate on the model to get a better accuracy. Once the final validation accuracy is 50% or greater, run the model on all the data in the next section.
In [68]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
print('Checking the Training on a Single Batch...')
x, y, keep_prob_1, keep_prob_2, lr, summary, optimizer, cost, accuracy, is_training = build_op()
with tf.Session() as sess:
# Initializing the variables
sess.run(tf.global_variables_initializer())
# Training cycle
learning_rate = learning_rate_init
for epoch in range(epochs):
batch_i = 1
if epoch >= 81:
learning_rate = learning_rate/10
if epoch >= 122:
learning_rate = learning_rate/10
for batch_features, batch_labels in load_preprocess_training_batch(batch_i, batch_size):
train_neural_network(sess, optimizer, keep_probability, batch_features, batch_labels, learning_rate)
print('Epoch {:>2}, CIFAR-10 Batch {}: '.format(epoch + 1, batch_i), end='')
print_stats(sess, batch_features, batch_labels, cost, accuracy, learning_rate)
Checking the Training on a Single Batch... Epoch 1, CIFAR-10 Batch 1: Loss: 1.9473 Validation Accuracy: 0.245000 Epoch 2, CIFAR-10 Batch 1: Loss: 1.8300 Validation Accuracy: 0.322200 Epoch 3, CIFAR-10 Batch 1: Loss: 1.7565 Validation Accuracy: 0.365400 Epoch 4, CIFAR-10 Batch 1: Loss: 1.6513 Validation Accuracy: 0.450600 Epoch 5, CIFAR-10 Batch 1: Loss: 1.5445 Validation Accuracy: 0.505800 Epoch 6, CIFAR-10 Batch 1: Loss: 1.4710 Validation Accuracy: 0.470400 Epoch 7, CIFAR-10 Batch 1: Loss: 1.3845 Validation Accuracy: 0.506400 Epoch 8, CIFAR-10 Batch 1: Loss: 1.3021 Validation Accuracy: 0.527400 Epoch 9, CIFAR-10 Batch 1: Loss: 1.3158 Validation Accuracy: 0.525400 Epoch 10, CIFAR-10 Batch 1: Loss: 1.2315 Validation Accuracy: 0.537400 Epoch 11, CIFAR-10 Batch 1: Loss: 1.1612 Validation Accuracy: 0.572400 Epoch 12, CIFAR-10 Batch 1: Loss: 1.1000 Validation Accuracy: 0.535000 Epoch 13, CIFAR-10 Batch 1: Loss: 1.0416 Validation Accuracy: 0.570200 Epoch 14, CIFAR-10 Batch 1: Loss: 0.9602 Validation Accuracy: 0.608000 Epoch 15, CIFAR-10 Batch 1: Loss: 0.9714 Validation Accuracy: 0.602800 Epoch 16, CIFAR-10 Batch 1: Loss: 0.8982 Validation Accuracy: 0.517000 Epoch 17, CIFAR-10 Batch 1: Loss: 0.8280 Validation Accuracy: 0.575000 Epoch 18, CIFAR-10 Batch 1: Loss: 0.8111 Validation Accuracy: 0.585200 Epoch 19, CIFAR-10 Batch 1: Loss: 0.6945 Validation Accuracy: 0.525200 Epoch 20, CIFAR-10 Batch 1: Loss: 0.6684 Validation Accuracy: 0.578600 Epoch 21, CIFAR-10 Batch 1: Loss: 0.6277 Validation Accuracy: 0.538400 Epoch 22, CIFAR-10 Batch 1: Loss: 0.4801 Validation Accuracy: 0.495600 Epoch 23, CIFAR-10 Batch 1: Loss: 0.4274 Validation Accuracy: 0.462600 Epoch 24, CIFAR-10 Batch 1: Loss: 0.3744 Validation Accuracy: 0.441400 Epoch 25, CIFAR-10 Batch 1: Loss: 0.3458 Validation Accuracy: 0.504200 Epoch 26, CIFAR-10 Batch 1: Loss: 0.2972 Validation Accuracy: 0.580000 Epoch 27, CIFAR-10 Batch 1: Loss: 0.2757 Validation Accuracy: 0.563200 Epoch 28, CIFAR-10 Batch 1: Loss: 0.2899 Validation Accuracy: 0.537600 Epoch 29, CIFAR-10 Batch 1: Loss: 0.2370 Validation Accuracy: 0.568600 Epoch 30, CIFAR-10 Batch 1: Loss: 0.2387 Validation Accuracy: 0.590600 Epoch 31, CIFAR-10 Batch 1: Loss: 0.1828 Validation Accuracy: 0.573000 Epoch 32, CIFAR-10 Batch 1: Loss: 0.1950 Validation Accuracy: 0.579600 Epoch 33, CIFAR-10 Batch 1: Loss: 0.1770 Validation Accuracy: 0.611400 Epoch 34, CIFAR-10 Batch 1: Loss: 0.1637 Validation Accuracy: 0.605200 Epoch 35, CIFAR-10 Batch 1: Loss: 0.1738 Validation Accuracy: 0.629200 Epoch 36, CIFAR-10 Batch 1: Loss: 0.1693 Validation Accuracy: 0.633400 Epoch 37, CIFAR-10 Batch 1: Loss: 0.1542 Validation Accuracy: 0.623000 Epoch 38, CIFAR-10 Batch 1: Loss: 0.1278 Validation Accuracy: 0.627200 Epoch 39, CIFAR-10 Batch 1: Loss: 0.1338 Validation Accuracy: 0.663600 Epoch 40, CIFAR-10 Batch 1: Loss: 0.1442 Validation Accuracy: 0.629600 Epoch 41, CIFAR-10 Batch 1: Loss: 0.1399 Validation Accuracy: 0.531600 Epoch 42, CIFAR-10 Batch 1: Loss: 0.1365 Validation Accuracy: 0.636600 Epoch 43, CIFAR-10 Batch 1: Loss: 0.1174 Validation Accuracy: 0.601000 Epoch 44, CIFAR-10 Batch 1: Loss: 0.1176 Validation Accuracy: 0.598400 Epoch 45, CIFAR-10 Batch 1: Loss: 0.1337 Validation Accuracy: 0.635600 Epoch 46, CIFAR-10 Batch 1: Loss: 0.1209 Validation Accuracy: 0.651200 Epoch 47, CIFAR-10 Batch 1: Loss: 0.1171 Validation Accuracy: 0.595600 Epoch 48, CIFAR-10 Batch 1: Loss: 0.1334 Validation Accuracy: 0.582600 Epoch 49, CIFAR-10 Batch 1: Loss: 0.1040 Validation Accuracy: 0.645400 Epoch 50, CIFAR-10 Batch 1: Loss: 0.1083 Validation Accuracy: 0.638400 Epoch 51, CIFAR-10 Batch 1: Loss: 0.1134 Validation Accuracy: 0.610400 Epoch 52, CIFAR-10 Batch 1: Loss: 0.1063 Validation Accuracy: 0.633400 Epoch 53, CIFAR-10 Batch 1: Loss: 0.1231 Validation Accuracy: 0.641800 Epoch 54, CIFAR-10 Batch 1: Loss: 0.1090 Validation Accuracy: 0.637600 Epoch 55, CIFAR-10 Batch 1: Loss: 0.1052 Validation Accuracy: 0.633200 Epoch 56, CIFAR-10 Batch 1: Loss: 0.1076 Validation Accuracy: 0.616000 Epoch 57, CIFAR-10 Batch 1: Loss: 0.0998 Validation Accuracy: 0.640000 Epoch 58, CIFAR-10 Batch 1: Loss: 0.1085 Validation Accuracy: 0.593400 Epoch 59, CIFAR-10 Batch 1: Loss: 0.1015 Validation Accuracy: 0.638800 Epoch 60, CIFAR-10 Batch 1: Loss: 0.1088 Validation Accuracy: 0.591600 Epoch 61, CIFAR-10 Batch 1: Loss: 0.1022 Validation Accuracy: 0.615000 Epoch 62, CIFAR-10 Batch 1: Loss: 0.0991 Validation Accuracy: 0.620600 Epoch 63, CIFAR-10 Batch 1: Loss: 0.1034 Validation Accuracy: 0.658200 Epoch 64, CIFAR-10 Batch 1: Loss: 0.0995 Validation Accuracy: 0.615400 Epoch 65, CIFAR-10 Batch 1: Loss: 0.0991 Validation Accuracy: 0.654000 Epoch 66, CIFAR-10 Batch 1: Loss: 0.1123 Validation Accuracy: 0.653400 Epoch 67, CIFAR-10 Batch 1: Loss: 0.1027 Validation Accuracy: 0.633200 Epoch 68, CIFAR-10 Batch 1: Loss: 0.1232 Validation Accuracy: 0.658600 Epoch 69, CIFAR-10 Batch 1: Loss: 0.0990 Validation Accuracy: 0.659400 Epoch 70, CIFAR-10 Batch 1: Loss: 0.0992 Validation Accuracy: 0.662600 Epoch 71, CIFAR-10 Batch 1: Loss: 0.1059 Validation Accuracy: 0.647800 Epoch 72, CIFAR-10 Batch 1: Loss: 0.0996 Validation Accuracy: 0.658400 Epoch 73, CIFAR-10 Batch 1: Loss: 0.1017 Validation Accuracy: 0.660400 Epoch 74, CIFAR-10 Batch 1: Loss: 0.1001 Validation Accuracy: 0.660800 Epoch 75, CIFAR-10 Batch 1: Loss: 0.0991 Validation Accuracy: 0.656600 Epoch 76, CIFAR-10 Batch 1: Loss: 0.1005 Validation Accuracy: 0.607000 Epoch 77, CIFAR-10 Batch 1: Loss: 0.0995 Validation Accuracy: 0.623800 Epoch 78, CIFAR-10 Batch 1: Loss: 0.0977 Validation Accuracy: 0.630200 Epoch 79, CIFAR-10 Batch 1: Loss: 0.0996 Validation Accuracy: 0.681600 Epoch 80, CIFAR-10 Batch 1: Loss: 0.0967 Validation Accuracy: 0.671000 Epoch 81, CIFAR-10 Batch 1: Loss: 0.1000 Validation Accuracy: 0.675400 Epoch 82, CIFAR-10 Batch 1: Loss: 0.0945 Validation Accuracy: 0.706600 Epoch 83, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.713200 Epoch 84, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714000 Epoch 85, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714600 Epoch 86, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.713800 Epoch 87, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714400 Epoch 88, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.713600 Epoch 89, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.713800 Epoch 90, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.713600 Epoch 91, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714200 Epoch 92, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714200 Epoch 93, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714400 Epoch 94, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714000 Epoch 95, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714800 Epoch 96, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714000 Epoch 97, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.715200 Epoch 98, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714800 Epoch 99, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714000 Epoch 100, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714000 Epoch 101, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.713800 Epoch 102, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714000 Epoch 103, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714800 Epoch 104, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714000 Epoch 105, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714200 Epoch 106, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714200 Epoch 107, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.715000 Epoch 108, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714000 Epoch 109, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.713600 Epoch 110, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.715000 Epoch 111, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714200 Epoch 112, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.713800 Epoch 113, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714200 Epoch 114, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714800 Epoch 115, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714000 Epoch 116, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.715000 Epoch 117, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714400 Epoch 118, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714000 Epoch 119, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714200 Epoch 120, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.713600 Epoch 121, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714000 Epoch 122, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.713800 Epoch 123, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714800 Epoch 124, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714200 Epoch 125, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.713800 Epoch 126, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.713400 Epoch 127, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.713600 Epoch 128, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714800 Epoch 129, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.715000 Epoch 130, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.713600 Epoch 131, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.715800 Epoch 132, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714200 Epoch 133, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714200 Epoch 134, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714600 Epoch 135, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714800 Epoch 136, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714200 Epoch 137, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714800 Epoch 138, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714400 Epoch 139, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714000 Epoch 140, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.713800 Epoch 141, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714800 Epoch 142, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714600 Epoch 143, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.715400 Epoch 144, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714200 Epoch 145, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714200 Epoch 146, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714200 Epoch 147, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714000 Epoch 148, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714000 Epoch 149, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.715200 Epoch 150, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714400 Epoch 151, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.715000 Epoch 152, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714600 Epoch 153, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714600 Epoch 154, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714200 Epoch 155, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714400 Epoch 156, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.715000 Epoch 157, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714800 Epoch 158, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.715400 Epoch 159, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.713800 Epoch 160, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714200 Epoch 161, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714400 Epoch 162, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714000 Epoch 163, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.713200 Epoch 164, CIFAR-10 Batch 1: Loss: 0.0944 Validation Accuracy: 0.714200
Fully Train the Model¶
Now that you got a good accuracy with a single CIFAR-10 batch, try it with all five batches.
In [ ]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
save_model_path = './image_classification'
loss = []
acc = []
x, y, keep_prob_1, keep_prob_2, lr, summary, optimizer, cost, accuracy, is_training = build_op()
print('Training...')
with tf.Session() as sess:
# Initializing the variables
sess.run(tf.global_variables_initializer())
learning_rate = learning_rate_init
# Training cycle
for epoch in range(epochs):
# Loop over all batches
n_batches = 50
if epoch >= 81:
learning_rate = learning_rate/10
if epoch >= 122:
learning_rate = learning_rate/10
for batch_i in range(1, n_batches + 1):
for batch_features, batch_labels in load_preprocess_training_batch(batch_i, batch_size):
train_neural_network(sess, optimizer, keep_probability, batch_features, batch_labels, learning_rate)
print('Epoch {:>2}, CIFAR-10 Batch {}: '.format(epoch + 1, batch_i), end='')
train_loss,val_acc=print_stats(sess, batch_features, batch_labels, cost, accuracy, learning_rate)
loss.append(train_loss)
acc.append(val_acc)
# Save Model
saver = tf.train.Saver()
save_path = saver.save(sess, save_model_path)
In [ ]:
import matplotlib.pyplot as plt
%matplotlib inline
plt.plot(loss, label='Validation loss', color='darkorange')
plt.legend()
_ = plt.ylim()
In [ ]:
import matplotlib.pyplot as plt
%matplotlib inline
plt.plot(acc, label='Validation accuracy', color='green')
plt.legend()
_ = plt.ylim()
In [22]:
#for batch_size in [512, 128, 32, 8, 2]:
#for learning_rate in [0.01, 0.001, 0.0001]:
x, y, keep_prob_1, keep_prob_2, lr, summary, optimizer, cost, accuracy, is_training = build_op()
with tf.Session() as sess:
steps = 0
counter = 0
learning_rate = learning_rate_init
# Initializing the variables
sess.run(tf.global_variables_initializer())
# If you want to compare training and validation, one good way to do it is to use two separate
# file writer to keep logs for each process but keep them in the same folder. This way, you can
# later view them in the same plot.
#train_log_string = 'log/train, learning_rate={:.5f}, batch_size={}'.format(learning_rate, batch_size)
valid_log_string = './tmp/log/valid, learning_rate={:.5f}, batch_size={}'.format(learning_rate, batch_size)
#train_filewriter = tf.summary.FileWriter(train_log_string, sess.graph)
valid_filewriter = tf.summary.FileWriter(valid_log_string, sess.graph)
# Training cycle
for epoch in range(epochs):
# Loop over all batches
n_batches = 50
if epoch >= 81:
learning_rate = learning_rate/10
if epoch >= 122:
learning_rate = learning_rate/10
for batch_i in range(1, n_batches + 1):
for batch_features, batch_labels in load_preprocess_training_batch(batch_i, batch_size):
steps += batch_features.shape[0]
counter += batch_features.shape[0]
sess.run(optimizer, feed_dict={x: batch_features, y: batch_labels,
keep_prob_1:keep_probability[0], keep_prob_2:keep_probability[1],
lr:learning_rate, is_training:True})
# Log only after the model is trained on every 500 samples. Getting summary takes time, so the
# more frequently you look, the more extra time it'll cost you.
if counter > 1000:
#train_summ = sess.run(summary, feed_dict={x: batch_features, y: batch_labels,
# keep_prob: 1., lr:learning_rate})
#train_filewriter.add_summary(train_summ, steps)
valid_summ = sess.run(summary, feed_dict={x: valid_features, y: valid_labels,
keep_prob_1:1.0, keep_prob_2:1.0,
lr:learning_rate, is_training:False})
valid_filewriter.add_summary(valid_summ, steps)
counter -= 1000
loss = sess.run(cost, feed_dict={x:batch_features, y:batch_labels, keep_prob_1:1.0, keep_prob_2:1.0,
lr:learning_rate, is_training:True})
valid_acc = sess.run(accuracy, feed_dict={x: valid_features, y: valid_labels, keep_prob_1:1.0, keep_prob_2:1.0,
lr:learning_rate, is_training:False})
print('Epoch {:>2}, CIFAR-10 Batch {}: '.format(epoch + 1, batch_i), end='')
print('Loss: {:>10.4f} Validation Accuracy: {:.6f}'.format(loss, valid_acc))
# Save Model
save_model_path = './image_classification'
saver = tf.train.Saver()
save_path = saver.save(sess, save_model_path)
Epoch 1, CIFAR-10 Batch 1: Loss: 1.9208 Validation Accuracy: 0.174200 Epoch 1, CIFAR-10 Batch 2: Loss: 1.6730 Validation Accuracy: 0.209200 Epoch 1, CIFAR-10 Batch 3: Loss: 1.6251 Validation Accuracy: 0.233200 Epoch 1, CIFAR-10 Batch 4: Loss: 1.7033 Validation Accuracy: 0.343000 Epoch 1, CIFAR-10 Batch 5: Loss: 1.4564 Validation Accuracy: 0.496800 Epoch 1, CIFAR-10 Batch 6: Loss: 1.6997 Validation Accuracy: 0.377200 Epoch 1, CIFAR-10 Batch 7: Loss: 1.6182 Validation Accuracy: 0.497200 Epoch 1, CIFAR-10 Batch 8: Loss: 1.4463 Validation Accuracy: 0.513800 Epoch 1, CIFAR-10 Batch 9: Loss: 1.7632 Validation Accuracy: 0.533800 Epoch 1, CIFAR-10 Batch 10: Loss: 1.2241 Validation Accuracy: 0.496000 Epoch 1, CIFAR-10 Batch 11: Loss: 1.4642 Validation Accuracy: 0.530200 Epoch 1, CIFAR-10 Batch 12: Loss: 1.4035 Validation Accuracy: 0.541600 Epoch 1, CIFAR-10 Batch 13: Loss: 1.2370 Validation Accuracy: 0.562400 Epoch 1, CIFAR-10 Batch 14: Loss: 1.2854 Validation Accuracy: 0.590000 Epoch 1, CIFAR-10 Batch 15: Loss: 1.3215 Validation Accuracy: 0.567800 Epoch 1, CIFAR-10 Batch 16: Loss: 1.2504 Validation Accuracy: 0.582800 Epoch 1, CIFAR-10 Batch 17: Loss: 1.4759 Validation Accuracy: 0.632400 Epoch 1, CIFAR-10 Batch 18: Loss: 1.1935 Validation Accuracy: 0.600000 Epoch 1, CIFAR-10 Batch 19: Loss: 1.1605 Validation Accuracy: 0.576000 Epoch 1, CIFAR-10 Batch 20: Loss: 1.2916 Validation Accuracy: 0.588000 Epoch 1, CIFAR-10 Batch 21: Loss: 1.1423 Validation Accuracy: 0.642400 Epoch 1, CIFAR-10 Batch 22: Loss: 1.1655 Validation Accuracy: 0.639800 Epoch 1, CIFAR-10 Batch 23: Loss: 1.1246 Validation Accuracy: 0.613800 Epoch 1, CIFAR-10 Batch 24: Loss: 1.0855 Validation Accuracy: 0.674200 Epoch 1, CIFAR-10 Batch 25: Loss: 0.9019 Validation Accuracy: 0.638200 Epoch 1, CIFAR-10 Batch 26: Loss: 0.9625 Validation Accuracy: 0.668800 Epoch 1, CIFAR-10 Batch 27: Loss: 0.8419 Validation Accuracy: 0.586000 Epoch 1, CIFAR-10 Batch 28: Loss: 1.0346 Validation Accuracy: 0.672200 Epoch 1, CIFAR-10 Batch 29: Loss: 1.0232 Validation Accuracy: 0.679000 Epoch 1, CIFAR-10 Batch 30: Loss: 0.9698 Validation Accuracy: 0.687800 Epoch 1, CIFAR-10 Batch 31: Loss: 0.9707 Validation Accuracy: 0.710600 Epoch 1, CIFAR-10 Batch 32: Loss: 0.9137 Validation Accuracy: 0.621200 Epoch 1, CIFAR-10 Batch 33: Loss: 1.0874 Validation Accuracy: 0.703400 Epoch 1, CIFAR-10 Batch 34: Loss: 1.2363 Validation Accuracy: 0.706400 Epoch 1, CIFAR-10 Batch 35: Loss: 0.8887 Validation Accuracy: 0.684400 Epoch 1, CIFAR-10 Batch 36: Loss: 0.9751 Validation Accuracy: 0.714800 Epoch 1, CIFAR-10 Batch 37: Loss: 0.9450 Validation Accuracy: 0.705600 Epoch 1, CIFAR-10 Batch 38: Loss: 0.9124 Validation Accuracy: 0.618400 Epoch 1, CIFAR-10 Batch 39: Loss: 0.9223 Validation Accuracy: 0.714200 Epoch 1, CIFAR-10 Batch 40: Loss: 1.0030 Validation Accuracy: 0.668000 Epoch 1, CIFAR-10 Batch 41: Loss: 0.7837 Validation Accuracy: 0.734600 Epoch 1, CIFAR-10 Batch 42: Loss: 0.9506 Validation Accuracy: 0.669400 Epoch 1, CIFAR-10 Batch 43: Loss: 1.1570 Validation Accuracy: 0.746000 Epoch 1, CIFAR-10 Batch 44: Loss: 0.9120 Validation Accuracy: 0.748200 Epoch 1, CIFAR-10 Batch 45: Loss: 0.9285 Validation Accuracy: 0.728000 Epoch 1, CIFAR-10 Batch 46: Loss: 1.0531 Validation Accuracy: 0.733400 Epoch 1, CIFAR-10 Batch 47: Loss: 0.9210 Validation Accuracy: 0.745800 Epoch 1, CIFAR-10 Batch 48: Loss: 0.9449 Validation Accuracy: 0.718400 Epoch 1, CIFAR-10 Batch 49: Loss: 1.0961 Validation Accuracy: 0.718200 Epoch 1, CIFAR-10 Batch 50: Loss: 0.8137 Validation Accuracy: 0.730600 Epoch 2, CIFAR-10 Batch 1: Loss: 1.0757 Validation Accuracy: 0.747800 Epoch 2, CIFAR-10 Batch 2: Loss: 0.7843 Validation Accuracy: 0.742200 Epoch 2, CIFAR-10 Batch 3: Loss: 0.5884 Validation Accuracy: 0.763200 Epoch 2, CIFAR-10 Batch 4: Loss: 0.7745 Validation Accuracy: 0.773400 Epoch 2, CIFAR-10 Batch 5: Loss: 0.7567 Validation Accuracy: 0.754000 Epoch 2, CIFAR-10 Batch 6: Loss: 0.8854 Validation Accuracy: 0.728400 Epoch 2, CIFAR-10 Batch 7: Loss: 0.7489 Validation Accuracy: 0.745200 Epoch 2, CIFAR-10 Batch 8: Loss: 0.8628 Validation Accuracy: 0.715600 Epoch 2, CIFAR-10 Batch 9: Loss: 0.9758 Validation Accuracy: 0.754400 Epoch 2, CIFAR-10 Batch 10: Loss: 0.5687 Validation Accuracy: 0.744400 Epoch 2, CIFAR-10 Batch 11: Loss: 0.8344 Validation Accuracy: 0.685400 Epoch 2, CIFAR-10 Batch 12: Loss: 0.8491 Validation Accuracy: 0.699800 Epoch 2, CIFAR-10 Batch 13: Loss: 0.6863 Validation Accuracy: 0.712400 Epoch 2, CIFAR-10 Batch 14: Loss: 0.7866 Validation Accuracy: 0.696200 Epoch 2, CIFAR-10 Batch 15: Loss: 0.8216 Validation Accuracy: 0.738600 Epoch 2, CIFAR-10 Batch 16: Loss: 0.7869 Validation Accuracy: 0.713000 Epoch 2, CIFAR-10 Batch 17: Loss: 1.0868 Validation Accuracy: 0.726400 Epoch 2, CIFAR-10 Batch 18: Loss: 0.7462 Validation Accuracy: 0.754600 Epoch 2, CIFAR-10 Batch 19: Loss: 0.5720 Validation Accuracy: 0.782200 Epoch 2, CIFAR-10 Batch 20: Loss: 1.0012 Validation Accuracy: 0.669600 Epoch 2, CIFAR-10 Batch 21: Loss: 0.7812 Validation Accuracy: 0.761400 Epoch 2, CIFAR-10 Batch 22: Loss: 0.7020 Validation Accuracy: 0.761000 Epoch 2, CIFAR-10 Batch 23: Loss: 0.7683 Validation Accuracy: 0.762200 Epoch 2, CIFAR-10 Batch 24: Loss: 0.7788 Validation Accuracy: 0.766000 Epoch 2, CIFAR-10 Batch 25: Loss: 0.6861 Validation Accuracy: 0.717200 Epoch 2, CIFAR-10 Batch 26: Loss: 0.6700 Validation Accuracy: 0.773000 Epoch 2, CIFAR-10 Batch 27: Loss: 0.5275 Validation Accuracy: 0.747200 Epoch 2, CIFAR-10 Batch 28: Loss: 0.7901 Validation Accuracy: 0.791400 Epoch 2, CIFAR-10 Batch 29: Loss: 0.6763 Validation Accuracy: 0.797800 Epoch 2, CIFAR-10 Batch 30: Loss: 0.5639 Validation Accuracy: 0.742800 Epoch 2, CIFAR-10 Batch 31: Loss: 0.6402 Validation Accuracy: 0.763400 Epoch 2, CIFAR-10 Batch 32: Loss: 0.6679 Validation Accuracy: 0.716200 Epoch 2, CIFAR-10 Batch 33: Loss: 0.8889 Validation Accuracy: 0.761000 Epoch 2, CIFAR-10 Batch 34: Loss: 0.9139 Validation Accuracy: 0.757800 Epoch 2, CIFAR-10 Batch 35: Loss: 0.6554 Validation Accuracy: 0.794800 Epoch 2, CIFAR-10 Batch 36: Loss: 0.6063 Validation Accuracy: 0.782000 Epoch 2, CIFAR-10 Batch 37: Loss: 0.6947 Validation Accuracy: 0.783200 Epoch 2, CIFAR-10 Batch 38: Loss: 0.6220 Validation Accuracy: 0.760000 Epoch 2, CIFAR-10 Batch 39: Loss: 0.5616 Validation Accuracy: 0.797000 Epoch 2, CIFAR-10 Batch 40: Loss: 0.6915 Validation Accuracy: 0.770000 Epoch 2, CIFAR-10 Batch 41: Loss: 0.6883 Validation Accuracy: 0.771000 Epoch 2, CIFAR-10 Batch 42: Loss: 0.7191 Validation Accuracy: 0.780600 Epoch 2, CIFAR-10 Batch 43: Loss: 0.8712 Validation Accuracy: 0.788000 Epoch 2, CIFAR-10 Batch 44: Loss: 0.7848 Validation Accuracy: 0.769200 Epoch 2, CIFAR-10 Batch 45: Loss: 0.7162 Validation Accuracy: 0.792600 Epoch 2, CIFAR-10 Batch 46: Loss: 0.7813 Validation Accuracy: 0.781000 Epoch 2, CIFAR-10 Batch 47: Loss: 0.7729 Validation Accuracy: 0.798800 Epoch 2, CIFAR-10 Batch 48: Loss: 0.8163 Validation Accuracy: 0.796200 Epoch 2, CIFAR-10 Batch 49: Loss: 0.8486 Validation Accuracy: 0.789400 Epoch 2, CIFAR-10 Batch 50: Loss: 0.6461 Validation Accuracy: 0.774200 Epoch 3, CIFAR-10 Batch 1: Loss: 0.8442 Validation Accuracy: 0.794400 Epoch 3, CIFAR-10 Batch 2: Loss: 0.5837 Validation Accuracy: 0.790800 Epoch 3, CIFAR-10 Batch 3: Loss: 0.4160 Validation Accuracy: 0.808800 Epoch 3, CIFAR-10 Batch 4: Loss: 0.5626 Validation Accuracy: 0.807400 Epoch 3, CIFAR-10 Batch 5: Loss: 0.5924 Validation Accuracy: 0.783200 Epoch 3, CIFAR-10 Batch 6: Loss: 0.7246 Validation Accuracy: 0.809400 Epoch 3, CIFAR-10 Batch 7: Loss: 0.6370 Validation Accuracy: 0.748400 Epoch 3, CIFAR-10 Batch 8: Loss: 0.7720 Validation Accuracy: 0.798200 Epoch 3, CIFAR-10 Batch 9: Loss: 0.7056 Validation Accuracy: 0.786200 Epoch 3, CIFAR-10 Batch 10: Loss: 0.3422 Validation Accuracy: 0.812600 Epoch 3, CIFAR-10 Batch 11: Loss: 0.8171 Validation Accuracy: 0.780600 Epoch 3, CIFAR-10 Batch 12: Loss: 0.6999 Validation Accuracy: 0.804200 Epoch 3, CIFAR-10 Batch 13: Loss: 0.6454 Validation Accuracy: 0.792400 Epoch 3, CIFAR-10 Batch 14: Loss: 0.6584 Validation Accuracy: 0.806400 Epoch 3, CIFAR-10 Batch 15: Loss: 0.7725 Validation Accuracy: 0.785000 Epoch 3, CIFAR-10 Batch 16: Loss: 0.6285 Validation Accuracy: 0.774000 Epoch 3, CIFAR-10 Batch 17: Loss: 0.9312 Validation Accuracy: 0.818200 Epoch 3, CIFAR-10 Batch 18: Loss: 0.5154 Validation Accuracy: 0.810000 Epoch 3, CIFAR-10 Batch 19: Loss: 0.4664 Validation Accuracy: 0.806400 Epoch 3, CIFAR-10 Batch 20: Loss: 0.8741 Validation Accuracy: 0.800800 Epoch 3, CIFAR-10 Batch 21: Loss: 0.6356 Validation Accuracy: 0.778800 Epoch 3, CIFAR-10 Batch 22: Loss: 0.6921 Validation Accuracy: 0.799000 Epoch 3, CIFAR-10 Batch 23: Loss: 0.6691 Validation Accuracy: 0.810400 Epoch 3, CIFAR-10 Batch 24: Loss: 0.6628 Validation Accuracy: 0.785400 Epoch 3, CIFAR-10 Batch 25: Loss: 0.6018 Validation Accuracy: 0.775400 Epoch 3, CIFAR-10 Batch 26: Loss: 0.4532 Validation Accuracy: 0.809200 Epoch 3, CIFAR-10 Batch 27: Loss: 0.4650 Validation Accuracy: 0.776400 Epoch 3, CIFAR-10 Batch 28: Loss: 0.7295 Validation Accuracy: 0.799400 Epoch 3, CIFAR-10 Batch 29: Loss: 0.5872 Validation Accuracy: 0.815200 Epoch 3, CIFAR-10 Batch 30: Loss: 0.3991 Validation Accuracy: 0.796600 Epoch 3, CIFAR-10 Batch 31: Loss: 0.5118 Validation Accuracy: 0.762200 Epoch 3, CIFAR-10 Batch 32: Loss: 0.4789 Validation Accuracy: 0.787400 Epoch 3, CIFAR-10 Batch 33: Loss: 0.8369 Validation Accuracy: 0.813400 Epoch 3, CIFAR-10 Batch 34: Loss: 0.7313 Validation Accuracy: 0.767400 Epoch 3, CIFAR-10 Batch 35: Loss: 0.6416 Validation Accuracy: 0.764400 Epoch 3, CIFAR-10 Batch 36: Loss: 0.5685 Validation Accuracy: 0.791600 Epoch 3, CIFAR-10 Batch 37: Loss: 0.6867 Validation Accuracy: 0.816600 Epoch 3, CIFAR-10 Batch 38: Loss: 0.4069 Validation Accuracy: 0.748000 Epoch 3, CIFAR-10 Batch 39: Loss: 0.5245 Validation Accuracy: 0.813600 Epoch 3, CIFAR-10 Batch 40: Loss: 0.6984 Validation Accuracy: 0.802800 Epoch 3, CIFAR-10 Batch 41: Loss: 0.5141 Validation Accuracy: 0.776200 Epoch 3, CIFAR-10 Batch 42: Loss: 0.6209 Validation Accuracy: 0.813600 Epoch 3, CIFAR-10 Batch 43: Loss: 0.7383 Validation Accuracy: 0.817000 Epoch 3, CIFAR-10 Batch 44: Loss: 0.6289 Validation Accuracy: 0.816200 Epoch 3, CIFAR-10 Batch 45: Loss: 0.6376 Validation Accuracy: 0.804600 Epoch 3, CIFAR-10 Batch 46: Loss: 0.6998 Validation Accuracy: 0.764800 Epoch 3, CIFAR-10 Batch 47: Loss: 0.5983 Validation Accuracy: 0.807200 Epoch 3, CIFAR-10 Batch 48: Loss: 0.6714 Validation Accuracy: 0.827800 Epoch 3, CIFAR-10 Batch 49: Loss: 0.7672 Validation Accuracy: 0.815200 Epoch 3, CIFAR-10 Batch 50: Loss: 0.5694 Validation Accuracy: 0.800400 Epoch 4, CIFAR-10 Batch 1: Loss: 0.6853 Validation Accuracy: 0.827000 Epoch 4, CIFAR-10 Batch 2: Loss: 0.4810 Validation Accuracy: 0.808400 Epoch 4, CIFAR-10 Batch 3: Loss: 0.3725 Validation Accuracy: 0.822000 Epoch 4, CIFAR-10 Batch 4: Loss: 0.5212 Validation Accuracy: 0.819400 Epoch 4, CIFAR-10 Batch 5: Loss: 0.5654 Validation Accuracy: 0.825400 Epoch 4, CIFAR-10 Batch 6: Loss: 0.7069 Validation Accuracy: 0.816400 Epoch 4, CIFAR-10 Batch 7: Loss: 0.4745 Validation Accuracy: 0.805800 Epoch 4, CIFAR-10 Batch 8: Loss: 0.7173 Validation Accuracy: 0.817000 Epoch 4, CIFAR-10 Batch 9: Loss: 0.7296 Validation Accuracy: 0.805000 Epoch 4, CIFAR-10 Batch 10: Loss: 0.3683 Validation Accuracy: 0.779200 Epoch 4, CIFAR-10 Batch 11: Loss: 0.6551 Validation Accuracy: 0.809800 Epoch 4, CIFAR-10 Batch 12: Loss: 0.7227 Validation Accuracy: 0.812600 Epoch 4, CIFAR-10 Batch 13: Loss: 0.5827 Validation Accuracy: 0.808600 Epoch 4, CIFAR-10 Batch 14: Loss: 0.5451 Validation Accuracy: 0.825600 Epoch 4, CIFAR-10 Batch 15: Loss: 0.6490 Validation Accuracy: 0.804400 Epoch 4, CIFAR-10 Batch 16: Loss: 0.6102 Validation Accuracy: 0.777600 Epoch 4, CIFAR-10 Batch 17: Loss: 0.7713 Validation Accuracy: 0.834400 Epoch 4, CIFAR-10 Batch 18: Loss: 0.4922 Validation Accuracy: 0.818400 Epoch 4, CIFAR-10 Batch 19: Loss: 0.4511 Validation Accuracy: 0.825800 Epoch 4, CIFAR-10 Batch 20: Loss: 0.7661 Validation Accuracy: 0.801200 Epoch 4, CIFAR-10 Batch 21: Loss: 0.6328 Validation Accuracy: 0.809800 Epoch 4, CIFAR-10 Batch 22: Loss: 0.5438 Validation Accuracy: 0.812800 Epoch 4, CIFAR-10 Batch 23: Loss: 0.5941 Validation Accuracy: 0.814600 Epoch 4, CIFAR-10 Batch 24: Loss: 0.6280 Validation Accuracy: 0.821200 Epoch 4, CIFAR-10 Batch 25: Loss: 0.4964 Validation Accuracy: 0.796600 Epoch 4, CIFAR-10 Batch 26: Loss: 0.4671 Validation Accuracy: 0.823800 Epoch 4, CIFAR-10 Batch 27: Loss: 0.3878 Validation Accuracy: 0.791800 Epoch 4, CIFAR-10 Batch 28: Loss: 0.5327 Validation Accuracy: 0.817400 Epoch 4, CIFAR-10 Batch 29: Loss: 0.5626 Validation Accuracy: 0.793400 Epoch 4, CIFAR-10 Batch 30: Loss: 0.3325 Validation Accuracy: 0.804800 Epoch 4, CIFAR-10 Batch 31: Loss: 0.5490 Validation Accuracy: 0.808200 Epoch 4, CIFAR-10 Batch 32: Loss: 0.3705 Validation Accuracy: 0.805600 Epoch 4, CIFAR-10 Batch 33: Loss: 0.6588 Validation Accuracy: 0.811400 Epoch 4, CIFAR-10 Batch 34: Loss: 0.7322 Validation Accuracy: 0.842800 Epoch 4, CIFAR-10 Batch 35: Loss: 0.5869 Validation Accuracy: 0.834600 Epoch 4, CIFAR-10 Batch 36: Loss: 0.5284 Validation Accuracy: 0.812400 Epoch 4, CIFAR-10 Batch 37: Loss: 0.5296 Validation Accuracy: 0.827600 Epoch 4, CIFAR-10 Batch 38: Loss: 0.3551 Validation Accuracy: 0.811400 Epoch 4, CIFAR-10 Batch 39: Loss: 0.3925 Validation Accuracy: 0.795200 Epoch 4, CIFAR-10 Batch 40: Loss: 0.5786 Validation Accuracy: 0.765800 Epoch 4, CIFAR-10 Batch 41: Loss: 0.5189 Validation Accuracy: 0.809200 Epoch 4, CIFAR-10 Batch 42: Loss: 0.5741 Validation Accuracy: 0.805000 Epoch 4, CIFAR-10 Batch 43: Loss: 0.6254 Validation Accuracy: 0.831000 Epoch 4, CIFAR-10 Batch 44: Loss: 0.4686 Validation Accuracy: 0.821800 Epoch 4, CIFAR-10 Batch 45: Loss: 0.5203 Validation Accuracy: 0.843000 Epoch 4, CIFAR-10 Batch 46: Loss: 0.6487 Validation Accuracy: 0.838000 Epoch 4, CIFAR-10 Batch 47: Loss: 0.5230 Validation Accuracy: 0.831400 Epoch 4, CIFAR-10 Batch 48: Loss: 0.5957 Validation Accuracy: 0.823600 Epoch 4, CIFAR-10 Batch 49: Loss: 0.7847 Validation Accuracy: 0.823800 Epoch 4, CIFAR-10 Batch 50: Loss: 0.5029 Validation Accuracy: 0.831400 Epoch 5, CIFAR-10 Batch 1: Loss: 0.5626 Validation Accuracy: 0.822000 Epoch 5, CIFAR-10 Batch 2: Loss: 0.4240 Validation Accuracy: 0.835200 Epoch 5, CIFAR-10 Batch 3: Loss: 0.3282 Validation Accuracy: 0.839400 Epoch 5, CIFAR-10 Batch 4: Loss: 0.4086 Validation Accuracy: 0.830000 Epoch 5, CIFAR-10 Batch 5: Loss: 0.4819 Validation Accuracy: 0.800800 Epoch 5, CIFAR-10 Batch 6: Loss: 0.6588 Validation Accuracy: 0.830600 Epoch 5, CIFAR-10 Batch 7: Loss: 0.3757 Validation Accuracy: 0.812400 Epoch 5, CIFAR-10 Batch 8: Loss: 0.6095 Validation Accuracy: 0.834000 Epoch 5, CIFAR-10 Batch 9: Loss: 0.6568 Validation Accuracy: 0.823000 Epoch 5, CIFAR-10 Batch 10: Loss: 0.3140 Validation Accuracy: 0.783800 Epoch 5, CIFAR-10 Batch 11: Loss: 0.5393 Validation Accuracy: 0.826400 Epoch 5, CIFAR-10 Batch 12: Loss: 0.6909 Validation Accuracy: 0.816400 Epoch 5, CIFAR-10 Batch 13: Loss: 0.5368 Validation Accuracy: 0.809400 Epoch 5, CIFAR-10 Batch 14: Loss: 0.5325 Validation Accuracy: 0.833400 Epoch 5, CIFAR-10 Batch 15: Loss: 0.5686 Validation Accuracy: 0.836200 Epoch 5, CIFAR-10 Batch 16: Loss: 0.4757 Validation Accuracy: 0.825800 Epoch 5, CIFAR-10 Batch 17: Loss: 0.7921 Validation Accuracy: 0.832800 Epoch 5, CIFAR-10 Batch 18: Loss: 0.4572 Validation Accuracy: 0.831000 Epoch 5, CIFAR-10 Batch 19: Loss: 0.3786 Validation Accuracy: 0.840400 Epoch 5, CIFAR-10 Batch 20: Loss: 0.6265 Validation Accuracy: 0.826200 Epoch 5, CIFAR-10 Batch 21: Loss: 0.6940 Validation Accuracy: 0.816000 Epoch 5, CIFAR-10 Batch 22: Loss: 0.5535 Validation Accuracy: 0.825200 Epoch 5, CIFAR-10 Batch 23: Loss: 0.4832 Validation Accuracy: 0.823000 Epoch 5, CIFAR-10 Batch 24: Loss: 0.6693 Validation Accuracy: 0.842200 Epoch 5, CIFAR-10 Batch 25: Loss: 0.4316 Validation Accuracy: 0.835800 Epoch 5, CIFAR-10 Batch 26: Loss: 0.4259 Validation Accuracy: 0.825800 Epoch 5, CIFAR-10 Batch 27: Loss: 0.2982 Validation Accuracy: 0.814200 Epoch 5, CIFAR-10 Batch 28: Loss: 0.5154 Validation Accuracy: 0.830200 Epoch 5, CIFAR-10 Batch 29: Loss: 0.4847 Validation Accuracy: 0.820000 Epoch 5, CIFAR-10 Batch 30: Loss: 0.3745 Validation Accuracy: 0.838200 Epoch 5, CIFAR-10 Batch 31: Loss: 0.4282 Validation Accuracy: 0.822400 Epoch 5, CIFAR-10 Batch 32: Loss: 0.3535 Validation Accuracy: 0.813400 Epoch 5, CIFAR-10 Batch 33: Loss: 0.6044 Validation Accuracy: 0.827000 Epoch 5, CIFAR-10 Batch 34: Loss: 0.7167 Validation Accuracy: 0.810600 Epoch 5, CIFAR-10 Batch 35: Loss: 0.5300 Validation Accuracy: 0.842000 Epoch 5, CIFAR-10 Batch 36: Loss: 0.4772 Validation Accuracy: 0.812600 Epoch 5, CIFAR-10 Batch 37: Loss: 0.5353 Validation Accuracy: 0.843400 Epoch 5, CIFAR-10 Batch 38: Loss: 0.3234 Validation Accuracy: 0.809600 Epoch 5, CIFAR-10 Batch 39: Loss: 0.2873 Validation Accuracy: 0.818800 Epoch 5, CIFAR-10 Batch 40: Loss: 0.4677 Validation Accuracy: 0.808800 Epoch 5, CIFAR-10 Batch 41: Loss: 0.4029 Validation Accuracy: 0.831000 Epoch 5, CIFAR-10 Batch 42: Loss: 0.5170 Validation Accuracy: 0.830600 Epoch 5, CIFAR-10 Batch 43: Loss: 0.5555 Validation Accuracy: 0.851200 Epoch 5, CIFAR-10 Batch 44: Loss: 0.4338 Validation Accuracy: 0.842000 Epoch 5, CIFAR-10 Batch 45: Loss: 0.5135 Validation Accuracy: 0.831200 Epoch 5, CIFAR-10 Batch 46: Loss: 0.5798 Validation Accuracy: 0.836600 Epoch 5, CIFAR-10 Batch 47: Loss: 0.4500 Validation Accuracy: 0.815400 Epoch 5, CIFAR-10 Batch 48: Loss: 0.5217 Validation Accuracy: 0.802400 Epoch 5, CIFAR-10 Batch 49: Loss: 0.6609 Validation Accuracy: 0.831800 Epoch 5, CIFAR-10 Batch 50: Loss: 0.4363 Validation Accuracy: 0.839600 Epoch 6, CIFAR-10 Batch 1: Loss: 0.4590 Validation Accuracy: 0.842400 Epoch 6, CIFAR-10 Batch 2: Loss: 0.4686 Validation Accuracy: 0.824600 Epoch 6, CIFAR-10 Batch 3: Loss: 0.3243 Validation Accuracy: 0.846000 Epoch 6, CIFAR-10 Batch 4: Loss: 0.3807 Validation Accuracy: 0.821200 Epoch 6, CIFAR-10 Batch 5: Loss: 0.4010 Validation Accuracy: 0.831000 Epoch 6, CIFAR-10 Batch 6: Loss: 0.6842 Validation Accuracy: 0.846600 Epoch 6, CIFAR-10 Batch 7: Loss: 0.4113 Validation Accuracy: 0.820400 Epoch 6, CIFAR-10 Batch 8: Loss: 0.6111 Validation Accuracy: 0.830400 Epoch 6, CIFAR-10 Batch 9: Loss: 0.6279 Validation Accuracy: 0.787000 Epoch 6, CIFAR-10 Batch 10: Loss: 0.2719 Validation Accuracy: 0.825600 Epoch 6, CIFAR-10 Batch 11: Loss: 0.5311 Validation Accuracy: 0.837600 Epoch 6, CIFAR-10 Batch 12: Loss: 0.5693 Validation Accuracy: 0.814400 Epoch 6, CIFAR-10 Batch 13: Loss: 0.5855 Validation Accuracy: 0.816000 Epoch 6, CIFAR-10 Batch 14: Loss: 0.5317 Validation Accuracy: 0.813800 Epoch 6, CIFAR-10 Batch 15: Loss: 0.4791 Validation Accuracy: 0.852600 Epoch 6, CIFAR-10 Batch 16: Loss: 0.4393 Validation Accuracy: 0.816600 Epoch 6, CIFAR-10 Batch 17: Loss: 0.8256 Validation Accuracy: 0.819200 Epoch 6, CIFAR-10 Batch 18: Loss: 0.4282 Validation Accuracy: 0.837400 Epoch 6, CIFAR-10 Batch 19: Loss: 0.3163 Validation Accuracy: 0.824400 Epoch 6, CIFAR-10 Batch 20: Loss: 0.5913 Validation Accuracy: 0.849800 Epoch 6, CIFAR-10 Batch 21: Loss: 0.5890 Validation Accuracy: 0.826000 Epoch 6, CIFAR-10 Batch 22: Loss: 0.5172 Validation Accuracy: 0.849800 Epoch 6, CIFAR-10 Batch 23: Loss: 0.5344 Validation Accuracy: 0.840800 Epoch 6, CIFAR-10 Batch 24: Loss: 0.4851 Validation Accuracy: 0.845800 Epoch 6, CIFAR-10 Batch 25: Loss: 0.4210 Validation Accuracy: 0.840000 Epoch 6, CIFAR-10 Batch 26: Loss: 0.4036 Validation Accuracy: 0.824200 Epoch 6, CIFAR-10 Batch 27: Loss: 0.2883 Validation Accuracy: 0.823600 Epoch 6, CIFAR-10 Batch 28: Loss: 0.4504 Validation Accuracy: 0.841800 Epoch 6, CIFAR-10 Batch 29: Loss: 0.4263 Validation Accuracy: 0.837600 Epoch 6, CIFAR-10 Batch 30: Loss: 0.2718 Validation Accuracy: 0.819600 Epoch 6, CIFAR-10 Batch 31: Loss: 0.3837 Validation Accuracy: 0.812000 Epoch 6, CIFAR-10 Batch 32: Loss: 0.3674 Validation Accuracy: 0.829200 Epoch 6, CIFAR-10 Batch 33: Loss: 0.5338 Validation Accuracy: 0.841400 Epoch 6, CIFAR-10 Batch 34: Loss: 0.7538 Validation Accuracy: 0.817200 Epoch 6, CIFAR-10 Batch 35: Loss: 0.5420 Validation Accuracy: 0.848800 Epoch 6, CIFAR-10 Batch 36: Loss: 0.4955 Validation Accuracy: 0.828800 Epoch 6, CIFAR-10 Batch 37: Loss: 0.3870 Validation Accuracy: 0.850800 Epoch 6, CIFAR-10 Batch 38: Loss: 0.2925 Validation Accuracy: 0.837000 Epoch 6, CIFAR-10 Batch 39: Loss: 0.3286 Validation Accuracy: 0.840800 Epoch 6, CIFAR-10 Batch 40: Loss: 0.3389 Validation Accuracy: 0.853800 Epoch 6, CIFAR-10 Batch 41: Loss: 0.3307 Validation Accuracy: 0.813400 Epoch 6, CIFAR-10 Batch 42: Loss: 0.5057 Validation Accuracy: 0.828800 Epoch 6, CIFAR-10 Batch 43: Loss: 0.4983 Validation Accuracy: 0.846400 Epoch 6, CIFAR-10 Batch 44: Loss: 0.4719 Validation Accuracy: 0.835800 Epoch 6, CIFAR-10 Batch 45: Loss: 0.4763 Validation Accuracy: 0.837800 Epoch 6, CIFAR-10 Batch 46: Loss: 0.5115 Validation Accuracy: 0.838200 Epoch 6, CIFAR-10 Batch 47: Loss: 0.3890 Validation Accuracy: 0.844400 Epoch 6, CIFAR-10 Batch 48: Loss: 0.4300 Validation Accuracy: 0.842200 Epoch 6, CIFAR-10 Batch 49: Loss: 0.6427 Validation Accuracy: 0.853200 Epoch 6, CIFAR-10 Batch 50: Loss: 0.4384 Validation Accuracy: 0.821800 Epoch 7, CIFAR-10 Batch 1: Loss: 0.4331 Validation Accuracy: 0.838200 Epoch 7, CIFAR-10 Batch 2: Loss: 0.3481 Validation Accuracy: 0.854600 Epoch 7, CIFAR-10 Batch 3: Loss: 0.2791 Validation Accuracy: 0.850600 Epoch 7, CIFAR-10 Batch 4: Loss: 0.3779 Validation Accuracy: 0.847600 Epoch 7, CIFAR-10 Batch 5: Loss: 0.3497 Validation Accuracy: 0.829800 Epoch 7, CIFAR-10 Batch 6: Loss: 0.6190 Validation Accuracy: 0.836600 Epoch 7, CIFAR-10 Batch 7: Loss: 0.2906 Validation Accuracy: 0.836400 Epoch 7, CIFAR-10 Batch 8: Loss: 0.5580 Validation Accuracy: 0.809400 Epoch 7, CIFAR-10 Batch 9: Loss: 0.5365 Validation Accuracy: 0.824600 Epoch 7, CIFAR-10 Batch 10: Loss: 0.1915 Validation Accuracy: 0.828400 Epoch 7, CIFAR-10 Batch 11: Loss: 0.5590 Validation Accuracy: 0.817000 Epoch 7, CIFAR-10 Batch 12: Loss: 0.5657 Validation Accuracy: 0.845400 Epoch 7, CIFAR-10 Batch 13: Loss: 0.5127 Validation Accuracy: 0.854200 Epoch 7, CIFAR-10 Batch 14: Loss: 0.4130 Validation Accuracy: 0.839600 Epoch 7, CIFAR-10 Batch 15: Loss: 0.5009 Validation Accuracy: 0.812200 Epoch 7, CIFAR-10 Batch 16: Loss: 0.3694 Validation Accuracy: 0.807200 Epoch 7, CIFAR-10 Batch 17: Loss: 0.7531 Validation Accuracy: 0.842000 Epoch 7, CIFAR-10 Batch 18: Loss: 0.3860 Validation Accuracy: 0.843600 Epoch 7, CIFAR-10 Batch 19: Loss: 0.2709 Validation Accuracy: 0.837600 Epoch 7, CIFAR-10 Batch 20: Loss: 0.5027 Validation Accuracy: 0.855400 Epoch 7, CIFAR-10 Batch 21: Loss: 0.5852 Validation Accuracy: 0.825600 Epoch 7, CIFAR-10 Batch 22: Loss: 0.5032 Validation Accuracy: 0.835400 Epoch 7, CIFAR-10 Batch 23: Loss: 0.4622 Validation Accuracy: 0.835000 Epoch 7, CIFAR-10 Batch 24: Loss: 0.4615 Validation Accuracy: 0.850800 Epoch 7, CIFAR-10 Batch 25: Loss: 0.3223 Validation Accuracy: 0.832600 Epoch 7, CIFAR-10 Batch 26: Loss: 0.3839 Validation Accuracy: 0.843400 Epoch 7, CIFAR-10 Batch 27: Loss: 0.2645 Validation Accuracy: 0.830600 Epoch 7, CIFAR-10 Batch 28: Loss: 0.4792 Validation Accuracy: 0.839400 Epoch 7, CIFAR-10 Batch 29: Loss: 0.4187 Validation Accuracy: 0.831400 Epoch 7, CIFAR-10 Batch 30: Loss: 0.3125 Validation Accuracy: 0.827000 Epoch 7, CIFAR-10 Batch 31: Loss: 0.4214 Validation Accuracy: 0.823200 Epoch 7, CIFAR-10 Batch 32: Loss: 0.3637 Validation Accuracy: 0.822200 Epoch 7, CIFAR-10 Batch 33: Loss: 0.5534 Validation Accuracy: 0.845200 Epoch 7, CIFAR-10 Batch 34: Loss: 0.6113 Validation Accuracy: 0.824000 Epoch 7, CIFAR-10 Batch 35: Loss: 0.5260 Validation Accuracy: 0.860400 Epoch 7, CIFAR-10 Batch 36: Loss: 0.4544 Validation Accuracy: 0.837400 Epoch 7, CIFAR-10 Batch 37: Loss: 0.3328 Validation Accuracy: 0.840400 Epoch 7, CIFAR-10 Batch 38: Loss: 0.2317 Validation Accuracy: 0.800400 Epoch 7, CIFAR-10 Batch 39: Loss: 0.3149 Validation Accuracy: 0.832000 Epoch 7, CIFAR-10 Batch 40: Loss: 0.4178 Validation Accuracy: 0.814000 Epoch 7, CIFAR-10 Batch 41: Loss: 0.3678 Validation Accuracy: 0.831200 Epoch 7, CIFAR-10 Batch 42: Loss: 0.3863 Validation Accuracy: 0.849000 Epoch 7, CIFAR-10 Batch 43: Loss: 0.5393 Validation Accuracy: 0.860600 Epoch 7, CIFAR-10 Batch 44: Loss: 0.3467 Validation Accuracy: 0.844600 Epoch 7, CIFAR-10 Batch 45: Loss: 0.4035 Validation Accuracy: 0.839000 Epoch 7, CIFAR-10 Batch 46: Loss: 0.5175 Validation Accuracy: 0.835000 Epoch 7, CIFAR-10 Batch 47: Loss: 0.3769 Validation Accuracy: 0.800200 Epoch 7, CIFAR-10 Batch 48: Loss: 0.4105 Validation Accuracy: 0.834400 Epoch 7, CIFAR-10 Batch 49: Loss: 0.5084 Validation Accuracy: 0.840200 Epoch 7, CIFAR-10 Batch 50: Loss: 0.3487 Validation Accuracy: 0.859800 Epoch 8, CIFAR-10 Batch 1: Loss: 0.3892 Validation Accuracy: 0.841400 Epoch 8, CIFAR-10 Batch 2: Loss: 0.3303 Validation Accuracy: 0.835600 Epoch 8, CIFAR-10 Batch 3: Loss: 0.2316 Validation Accuracy: 0.841000 Epoch 8, CIFAR-10 Batch 4: Loss: 0.3180 Validation Accuracy: 0.839200 Epoch 8, CIFAR-10 Batch 5: Loss: 0.3407 Validation Accuracy: 0.837800 Epoch 8, CIFAR-10 Batch 6: Loss: 0.5900 Validation Accuracy: 0.855600 Epoch 8, CIFAR-10 Batch 7: Loss: 0.3320 Validation Accuracy: 0.818200 Epoch 8, CIFAR-10 Batch 8: Loss: 0.4790 Validation Accuracy: 0.853000 Epoch 8, CIFAR-10 Batch 9: Loss: 0.5298 Validation Accuracy: 0.826600 Epoch 8, CIFAR-10 Batch 10: Loss: 0.2089 Validation Accuracy: 0.830600 Epoch 8, CIFAR-10 Batch 11: Loss: 0.4689 Validation Accuracy: 0.838800 Epoch 8, CIFAR-10 Batch 12: Loss: 0.5232 Validation Accuracy: 0.843000 Epoch 8, CIFAR-10 Batch 13: Loss: 0.5110 Validation Accuracy: 0.839600 Epoch 8, CIFAR-10 Batch 14: Loss: 0.4303 Validation Accuracy: 0.850800 Epoch 8, CIFAR-10 Batch 15: Loss: 0.4530 Validation Accuracy: 0.836200 Epoch 8, CIFAR-10 Batch 16: Loss: 0.2856 Validation Accuracy: 0.849000 Epoch 8, CIFAR-10 Batch 17: Loss: 0.6988 Validation Accuracy: 0.842600 Epoch 8, CIFAR-10 Batch 18: Loss: 0.3183 Validation Accuracy: 0.839800 Epoch 8, CIFAR-10 Batch 19: Loss: 0.2528 Validation Accuracy: 0.852600 Epoch 8, CIFAR-10 Batch 20: Loss: 0.5508 Validation Accuracy: 0.826800 Epoch 8, CIFAR-10 Batch 21: Loss: 0.4591 Validation Accuracy: 0.845600 Epoch 8, CIFAR-10 Batch 22: Loss: 0.4490 Validation Accuracy: 0.803400 Epoch 8, CIFAR-10 Batch 23: Loss: 0.4580 Validation Accuracy: 0.829600 Epoch 8, CIFAR-10 Batch 24: Loss: 0.4489 Validation Accuracy: 0.847000 Epoch 8, CIFAR-10 Batch 25: Loss: 0.3658 Validation Accuracy: 0.844200 Epoch 8, CIFAR-10 Batch 26: Loss: 0.3406 Validation Accuracy: 0.859200 Epoch 8, CIFAR-10 Batch 27: Loss: 0.3023 Validation Accuracy: 0.756600 Epoch 8, CIFAR-10 Batch 28: Loss: 0.4763 Validation Accuracy: 0.845400 Epoch 8, CIFAR-10 Batch 29: Loss: 0.4288 Validation Accuracy: 0.828200 Epoch 8, CIFAR-10 Batch 30: Loss: 0.2394 Validation Accuracy: 0.845800 Epoch 8, CIFAR-10 Batch 31: Loss: 0.4192 Validation Accuracy: 0.828600 Epoch 8, CIFAR-10 Batch 32: Loss: 0.3437 Validation Accuracy: 0.852200 Epoch 8, CIFAR-10 Batch 33: Loss: 0.5344 Validation Accuracy: 0.834800 Epoch 8, CIFAR-10 Batch 34: Loss: 0.6155 Validation Accuracy: 0.825800 Epoch 8, CIFAR-10 Batch 35: Loss: 0.4263 Validation Accuracy: 0.850400 Epoch 8, CIFAR-10 Batch 36: Loss: 0.4742 Validation Accuracy: 0.820200 Epoch 8, CIFAR-10 Batch 37: Loss: 0.3354 Validation Accuracy: 0.848600 Epoch 8, CIFAR-10 Batch 38: Loss: 0.2472 Validation Accuracy: 0.850400 Epoch 8, CIFAR-10 Batch 39: Loss: 0.2473 Validation Accuracy: 0.848800 Epoch 8, CIFAR-10 Batch 40: Loss: 0.4314 Validation Accuracy: 0.834600 Epoch 8, CIFAR-10 Batch 41: Loss: 0.3559 Validation Accuracy: 0.845600 Epoch 8, CIFAR-10 Batch 42: Loss: 0.4103 Validation Accuracy: 0.840000 Epoch 8, CIFAR-10 Batch 43: Loss: 0.5047 Validation Accuracy: 0.855800 Epoch 8, CIFAR-10 Batch 44: Loss: 0.4154 Validation Accuracy: 0.845000 Epoch 8, CIFAR-10 Batch 45: Loss: 0.4341 Validation Accuracy: 0.844600 Epoch 8, CIFAR-10 Batch 46: Loss: 0.4686 Validation Accuracy: 0.845200 Epoch 8, CIFAR-10 Batch 47: Loss: 0.3818 Validation Accuracy: 0.849600 Epoch 8, CIFAR-10 Batch 48: Loss: 0.3981 Validation Accuracy: 0.849400 Epoch 8, CIFAR-10 Batch 49: Loss: 0.5187 Validation Accuracy: 0.836800 Epoch 8, CIFAR-10 Batch 50: Loss: 0.3633 Validation Accuracy: 0.857800 Epoch 9, CIFAR-10 Batch 1: Loss: 0.3524 Validation Accuracy: 0.866400 Epoch 9, CIFAR-10 Batch 2: Loss: 0.3454 Validation Accuracy: 0.861400 Epoch 9, CIFAR-10 Batch 3: Loss: 0.2747 Validation Accuracy: 0.851800 Epoch 9, CIFAR-10 Batch 4: Loss: 0.3738 Validation Accuracy: 0.849400 Epoch 9, CIFAR-10 Batch 5: Loss: 0.4301 Validation Accuracy: 0.826800 Epoch 9, CIFAR-10 Batch 6: Loss: 0.5024 Validation Accuracy: 0.867400 Epoch 9, CIFAR-10 Batch 7: Loss: 0.2683 Validation Accuracy: 0.840800 Epoch 9, CIFAR-10 Batch 8: Loss: 0.4904 Validation Accuracy: 0.839200 Epoch 9, CIFAR-10 Batch 9: Loss: 0.5497 Validation Accuracy: 0.850600 Epoch 9, CIFAR-10 Batch 10: Loss: 0.2578 Validation Accuracy: 0.849600 Epoch 9, CIFAR-10 Batch 11: Loss: 0.4463 Validation Accuracy: 0.812400 Epoch 9, CIFAR-10 Batch 12: Loss: 0.4499 Validation Accuracy: 0.844000 Epoch 9, CIFAR-10 Batch 13: Loss: 0.4518 Validation Accuracy: 0.842000 Epoch 9, CIFAR-10 Batch 14: Loss: 0.3899 Validation Accuracy: 0.829200 Epoch 9, CIFAR-10 Batch 15: Loss: 0.3914 Validation Accuracy: 0.847600 Epoch 9, CIFAR-10 Batch 16: Loss: 0.4008 Validation Accuracy: 0.820200 Epoch 9, CIFAR-10 Batch 17: Loss: 0.7372 Validation Accuracy: 0.852200 Epoch 9, CIFAR-10 Batch 18: Loss: 0.3709 Validation Accuracy: 0.844000 Epoch 9, CIFAR-10 Batch 19: Loss: 0.2066 Validation Accuracy: 0.863600 Epoch 9, CIFAR-10 Batch 20: Loss: 0.5945 Validation Accuracy: 0.847000 Epoch 9, CIFAR-10 Batch 21: Loss: 0.4752 Validation Accuracy: 0.849400 Epoch 9, CIFAR-10 Batch 22: Loss: 0.3890 Validation Accuracy: 0.843000 Epoch 9, CIFAR-10 Batch 23: Loss: 0.4415 Validation Accuracy: 0.830600 Epoch 9, CIFAR-10 Batch 24: Loss: 0.4480 Validation Accuracy: 0.856200 Epoch 9, CIFAR-10 Batch 25: Loss: 0.3555 Validation Accuracy: 0.829400 Epoch 9, CIFAR-10 Batch 26: Loss: 0.3171 Validation Accuracy: 0.855600 Epoch 9, CIFAR-10 Batch 27: Loss: 0.2677 Validation Accuracy: 0.850200 Epoch 9, CIFAR-10 Batch 28: Loss: 0.5128 Validation Accuracy: 0.831000 Epoch 9, CIFAR-10 Batch 29: Loss: 0.3351 Validation Accuracy: 0.850200 Epoch 9, CIFAR-10 Batch 30: Loss: 0.2116 Validation Accuracy: 0.826200 Epoch 9, CIFAR-10 Batch 31: Loss: 0.3839 Validation Accuracy: 0.842600 Epoch 9, CIFAR-10 Batch 32: Loss: 0.2999 Validation Accuracy: 0.844600 Epoch 9, CIFAR-10 Batch 33: Loss: 0.4828 Validation Accuracy: 0.811800 Epoch 9, CIFAR-10 Batch 34: Loss: 0.6253 Validation Accuracy: 0.808600 Epoch 9, CIFAR-10 Batch 35: Loss: 0.4875 Validation Accuracy: 0.850800 Epoch 9, CIFAR-10 Batch 36: Loss: 0.4469 Validation Accuracy: 0.827800 Epoch 9, CIFAR-10 Batch 37: Loss: 0.3333 Validation Accuracy: 0.837600 Epoch 9, CIFAR-10 Batch 38: Loss: 0.1978 Validation Accuracy: 0.841800 Epoch 9, CIFAR-10 Batch 39: Loss: 0.2308 Validation Accuracy: 0.842000 Epoch 9, CIFAR-10 Batch 40: Loss: 0.4347 Validation Accuracy: 0.850600 Epoch 9, CIFAR-10 Batch 41: Loss: 0.3936 Validation Accuracy: 0.816400 Epoch 9, CIFAR-10 Batch 42: Loss: 0.3841 Validation Accuracy: 0.858400 Epoch 9, CIFAR-10 Batch 43: Loss: 0.4685 Validation Accuracy: 0.866400 Epoch 9, CIFAR-10 Batch 44: Loss: 0.3660 Validation Accuracy: 0.844200 Epoch 9, CIFAR-10 Batch 45: Loss: 0.3100 Validation Accuracy: 0.855800 Epoch 9, CIFAR-10 Batch 46: Loss: 0.4226 Validation Accuracy: 0.859200 Epoch 9, CIFAR-10 Batch 47: Loss: 0.3315 Validation Accuracy: 0.842600 Epoch 9, CIFAR-10 Batch 48: Loss: 0.3950 Validation Accuracy: 0.855400 Epoch 9, CIFAR-10 Batch 49: Loss: 0.4228 Validation Accuracy: 0.848600 Epoch 9, CIFAR-10 Batch 50: Loss: 0.3648 Validation Accuracy: 0.849400 Epoch 10, CIFAR-10 Batch 1: Loss: 0.2977 Validation Accuracy: 0.858400 Epoch 10, CIFAR-10 Batch 2: Loss: 0.3486 Validation Accuracy: 0.857800 Epoch 10, CIFAR-10 Batch 3: Loss: 0.2942 Validation Accuracy: 0.853200 Epoch 10, CIFAR-10 Batch 4: Loss: 0.2576 Validation Accuracy: 0.837400 Epoch 10, CIFAR-10 Batch 5: Loss: 0.2795 Validation Accuracy: 0.852000 Epoch 10, CIFAR-10 Batch 6: Loss: 0.5280 Validation Accuracy: 0.854200 Epoch 10, CIFAR-10 Batch 7: Loss: 0.2567 Validation Accuracy: 0.821200 Epoch 10, CIFAR-10 Batch 8: Loss: 0.5411 Validation Accuracy: 0.856400 Epoch 10, CIFAR-10 Batch 9: Loss: 0.4729 Validation Accuracy: 0.838600 Epoch 10, CIFAR-10 Batch 10: Loss: 0.2038 Validation Accuracy: 0.861800 Epoch 10, CIFAR-10 Batch 11: Loss: 0.4531 Validation Accuracy: 0.832400 Epoch 10, CIFAR-10 Batch 12: Loss: 0.4225 Validation Accuracy: 0.851800 Epoch 10, CIFAR-10 Batch 13: Loss: 0.3243 Validation Accuracy: 0.837400 Epoch 10, CIFAR-10 Batch 14: Loss: 0.3323 Validation Accuracy: 0.826600 Epoch 10, CIFAR-10 Batch 15: Loss: 0.4374 Validation Accuracy: 0.837800 Epoch 10, CIFAR-10 Batch 16: Loss: 0.2916 Validation Accuracy: 0.841800 Epoch 10, CIFAR-10 Batch 17: Loss: 0.6768 Validation Accuracy: 0.854800 Epoch 10, CIFAR-10 Batch 18: Loss: 0.2871 Validation Accuracy: 0.851400 Epoch 10, CIFAR-10 Batch 19: Loss: 0.2426 Validation Accuracy: 0.814400 Epoch 10, CIFAR-10 Batch 20: Loss: 0.5448 Validation Accuracy: 0.851200 Epoch 10, CIFAR-10 Batch 21: Loss: 0.4201 Validation Accuracy: 0.840400 Epoch 10, CIFAR-10 Batch 22: Loss: 0.3929 Validation Accuracy: 0.844800 Epoch 10, CIFAR-10 Batch 23: Loss: 0.5206 Validation Accuracy: 0.863400 Epoch 10, CIFAR-10 Batch 24: Loss: 0.3950 Validation Accuracy: 0.843800 Epoch 10, CIFAR-10 Batch 25: Loss: 0.2614 Validation Accuracy: 0.843600 Epoch 10, CIFAR-10 Batch 26: Loss: 0.3187 Validation Accuracy: 0.838200 Epoch 10, CIFAR-10 Batch 27: Loss: 0.2350 Validation Accuracy: 0.841600 Epoch 10, CIFAR-10 Batch 28: Loss: 0.4792 Validation Accuracy: 0.858400 Epoch 10, CIFAR-10 Batch 29: Loss: 0.3352 Validation Accuracy: 0.851600 Epoch 10, CIFAR-10 Batch 30: Loss: 0.2529 Validation Accuracy: 0.844200 Epoch 10, CIFAR-10 Batch 31: Loss: 0.3483 Validation Accuracy: 0.828200 Epoch 10, CIFAR-10 Batch 32: Loss: 0.3042 Validation Accuracy: 0.845600 Epoch 10, CIFAR-10 Batch 33: Loss: 0.4638 Validation Accuracy: 0.856600 Epoch 10, CIFAR-10 Batch 34: Loss: 0.5603 Validation Accuracy: 0.854000 Epoch 10, CIFAR-10 Batch 35: Loss: 0.4649 Validation Accuracy: 0.862200 Epoch 10, CIFAR-10 Batch 36: Loss: 0.4694 Validation Accuracy: 0.840800 Epoch 10, CIFAR-10 Batch 37: Loss: 0.3418 Validation Accuracy: 0.860200 Epoch 10, CIFAR-10 Batch 38: Loss: 0.1993 Validation Accuracy: 0.831600 Epoch 10, CIFAR-10 Batch 39: Loss: 0.2177 Validation Accuracy: 0.839600 Epoch 10, CIFAR-10 Batch 40: Loss: 0.3426 Validation Accuracy: 0.848800 Epoch 10, CIFAR-10 Batch 41: Loss: 0.3567 Validation Accuracy: 0.826600 Epoch 10, CIFAR-10 Batch 42: Loss: 0.3927 Validation Accuracy: 0.857000 Epoch 10, CIFAR-10 Batch 43: Loss: 0.4352 Validation Accuracy: 0.847000 Epoch 10, CIFAR-10 Batch 44: Loss: 0.3499 Validation Accuracy: 0.863200 Epoch 10, CIFAR-10 Batch 45: Loss: 0.3625 Validation Accuracy: 0.848600 Epoch 10, CIFAR-10 Batch 46: Loss: 0.4009 Validation Accuracy: 0.833000 Epoch 10, CIFAR-10 Batch 47: Loss: 0.3134 Validation Accuracy: 0.850800 Epoch 10, CIFAR-10 Batch 48: Loss: 0.3457 Validation Accuracy: 0.838600 Epoch 10, CIFAR-10 Batch 49: Loss: 0.4525 Validation Accuracy: 0.848200 Epoch 10, CIFAR-10 Batch 50: Loss: 0.3512 Validation Accuracy: 0.831800 Epoch 11, CIFAR-10 Batch 1: Loss: 0.2502 Validation Accuracy: 0.857400 Epoch 11, CIFAR-10 Batch 2: Loss: 0.3100 Validation Accuracy: 0.824800 Epoch 11, CIFAR-10 Batch 3: Loss: 0.2525 Validation Accuracy: 0.864000 Epoch 11, CIFAR-10 Batch 4: Loss: 0.2375 Validation Accuracy: 0.864400 Epoch 11, CIFAR-10 Batch 5: Loss: 0.3323 Validation Accuracy: 0.854000 Epoch 11, CIFAR-10 Batch 6: Loss: 0.5657 Validation Accuracy: 0.856800 Epoch 11, CIFAR-10 Batch 7: Loss: 0.2541 Validation Accuracy: 0.849000 Epoch 11, CIFAR-10 Batch 8: Loss: 0.5286 Validation Accuracy: 0.859800 Epoch 11, CIFAR-10 Batch 9: Loss: 0.4444 Validation Accuracy: 0.848000 Epoch 11, CIFAR-10 Batch 10: Loss: 0.1705 Validation Accuracy: 0.837200 Epoch 11, CIFAR-10 Batch 11: Loss: 0.3374 Validation Accuracy: 0.844000 Epoch 11, CIFAR-10 Batch 12: Loss: 0.4544 Validation Accuracy: 0.840400 Epoch 11, CIFAR-10 Batch 13: Loss: 0.3766 Validation Accuracy: 0.851200 Epoch 11, CIFAR-10 Batch 14: Loss: 0.3606 Validation Accuracy: 0.834000 Epoch 11, CIFAR-10 Batch 15: Loss: 0.3186 Validation Accuracy: 0.858800 Epoch 11, CIFAR-10 Batch 16: Loss: 0.2891 Validation Accuracy: 0.838000 Epoch 11, CIFAR-10 Batch 17: Loss: 0.6086 Validation Accuracy: 0.863200 Epoch 11, CIFAR-10 Batch 18: Loss: 0.3369 Validation Accuracy: 0.841000 Epoch 11, CIFAR-10 Batch 19: Loss: 0.2723 Validation Accuracy: 0.854800 Epoch 11, CIFAR-10 Batch 20: Loss: 0.4811 Validation Accuracy: 0.847400 Epoch 11, CIFAR-10 Batch 21: Loss: 0.4163 Validation Accuracy: 0.853800 Epoch 11, CIFAR-10 Batch 22: Loss: 0.3757 Validation Accuracy: 0.853000 Epoch 11, CIFAR-10 Batch 23: Loss: 0.4238 Validation Accuracy: 0.850200 Epoch 11, CIFAR-10 Batch 24: Loss: 0.3573 Validation Accuracy: 0.858600 Epoch 11, CIFAR-10 Batch 25: Loss: 0.3090 Validation Accuracy: 0.849800 Epoch 11, CIFAR-10 Batch 26: Loss: 0.2653 Validation Accuracy: 0.850000 Epoch 11, CIFAR-10 Batch 27: Loss: 0.2845 Validation Accuracy: 0.854400 Epoch 11, CIFAR-10 Batch 28: Loss: 0.4185 Validation Accuracy: 0.854800 Epoch 11, CIFAR-10 Batch 29: Loss: 0.3849 Validation Accuracy: 0.842000 Epoch 11, CIFAR-10 Batch 30: Loss: 0.2236 Validation Accuracy: 0.849800 Epoch 11, CIFAR-10 Batch 31: Loss: 0.2871 Validation Accuracy: 0.842400 Epoch 11, CIFAR-10 Batch 32: Loss: 0.2533 Validation Accuracy: 0.852600 Epoch 11, CIFAR-10 Batch 33: Loss: 0.5032 Validation Accuracy: 0.842800 Epoch 11, CIFAR-10 Batch 34: Loss: 0.5642 Validation Accuracy: 0.842400 Epoch 11, CIFAR-10 Batch 35: Loss: 0.4222 Validation Accuracy: 0.847200 Epoch 11, CIFAR-10 Batch 36: Loss: 0.4296 Validation Accuracy: 0.841400 Epoch 11, CIFAR-10 Batch 37: Loss: 0.3272 Validation Accuracy: 0.832400 Epoch 11, CIFAR-10 Batch 38: Loss: 0.1902 Validation Accuracy: 0.851200 Epoch 11, CIFAR-10 Batch 39: Loss: 0.2197 Validation Accuracy: 0.841000 Epoch 11, CIFAR-10 Batch 40: Loss: 0.4504 Validation Accuracy: 0.853200 Epoch 11, CIFAR-10 Batch 41: Loss: 0.3230 Validation Accuracy: 0.840200 Epoch 11, CIFAR-10 Batch 42: Loss: 0.2970 Validation Accuracy: 0.848400 Epoch 11, CIFAR-10 Batch 43: Loss: 0.4373 Validation Accuracy: 0.858800 Epoch 11, CIFAR-10 Batch 44: Loss: 0.3162 Validation Accuracy: 0.870000 Epoch 11, CIFAR-10 Batch 45: Loss: 0.3614 Validation Accuracy: 0.836000 Epoch 11, CIFAR-10 Batch 46: Loss: 0.4423 Validation Accuracy: 0.855200 Epoch 11, CIFAR-10 Batch 47: Loss: 0.2805 Validation Accuracy: 0.855200 Epoch 11, CIFAR-10 Batch 48: Loss: 0.3554 Validation Accuracy: 0.856400 Epoch 11, CIFAR-10 Batch 49: Loss: 0.4075 Validation Accuracy: 0.828000 Epoch 11, CIFAR-10 Batch 50: Loss: 0.3152 Validation Accuracy: 0.850000 Epoch 12, CIFAR-10 Batch 1: Loss: 0.2770 Validation Accuracy: 0.853600 Epoch 12, CIFAR-10 Batch 2: Loss: 0.2896 Validation Accuracy: 0.856600 Epoch 12, CIFAR-10 Batch 3: Loss: 0.2312 Validation Accuracy: 0.867400 Epoch 12, CIFAR-10 Batch 4: Loss: 0.2774 Validation Accuracy: 0.856000 Epoch 12, CIFAR-10 Batch 5: Loss: 0.3528 Validation Accuracy: 0.850000 Epoch 12, CIFAR-10 Batch 6: Loss: 0.4413 Validation Accuracy: 0.857600 Epoch 12, CIFAR-10 Batch 7: Loss: 0.2856 Validation Accuracy: 0.848200 Epoch 12, CIFAR-10 Batch 8: Loss: 0.4256 Validation Accuracy: 0.853400 Epoch 12, CIFAR-10 Batch 9: Loss: 0.4678 Validation Accuracy: 0.853400 Epoch 12, CIFAR-10 Batch 10: Loss: 0.1429 Validation Accuracy: 0.848200 Epoch 12, CIFAR-10 Batch 11: Loss: 0.4050 Validation Accuracy: 0.853200 Epoch 12, CIFAR-10 Batch 12: Loss: 0.3353 Validation Accuracy: 0.821000 Epoch 12, CIFAR-10 Batch 13: Loss: 0.3631 Validation Accuracy: 0.845400 Epoch 12, CIFAR-10 Batch 14: Loss: 0.4349 Validation Accuracy: 0.852000 Epoch 12, CIFAR-10 Batch 15: Loss: 0.3190 Validation Accuracy: 0.852000 Epoch 12, CIFAR-10 Batch 16: Loss: 0.3259 Validation Accuracy: 0.828000 Epoch 12, CIFAR-10 Batch 17: Loss: 0.5507 Validation Accuracy: 0.865600 Epoch 12, CIFAR-10 Batch 18: Loss: 0.2910 Validation Accuracy: 0.842000 Epoch 12, CIFAR-10 Batch 19: Loss: 0.2177 Validation Accuracy: 0.863000 Epoch 12, CIFAR-10 Batch 20: Loss: 0.5055 Validation Accuracy: 0.846800 Epoch 12, CIFAR-10 Batch 21: Loss: 0.3628 Validation Accuracy: 0.854200 Epoch 12, CIFAR-10 Batch 22: Loss: 0.3301 Validation Accuracy: 0.848600 Epoch 12, CIFAR-10 Batch 23: Loss: 0.4357 Validation Accuracy: 0.853000 Epoch 12, CIFAR-10 Batch 24: Loss: 0.4005 Validation Accuracy: 0.853000 Epoch 12, CIFAR-10 Batch 25: Loss: 0.3824 Validation Accuracy: 0.844200 Epoch 12, CIFAR-10 Batch 26: Loss: 0.2794 Validation Accuracy: 0.864600 Epoch 12, CIFAR-10 Batch 27: Loss: 0.2257 Validation Accuracy: 0.848800 Epoch 12, CIFAR-10 Batch 28: Loss: 0.4497 Validation Accuracy: 0.849800 Epoch 12, CIFAR-10 Batch 29: Loss: 0.3129 Validation Accuracy: 0.836200 Epoch 12, CIFAR-10 Batch 30: Loss: 0.2499 Validation Accuracy: 0.816800 Epoch 12, CIFAR-10 Batch 31: Loss: 0.2701 Validation Accuracy: 0.848800 Epoch 12, CIFAR-10 Batch 32: Loss: 0.2351 Validation Accuracy: 0.864800 Epoch 12, CIFAR-10 Batch 33: Loss: 0.4275 Validation Accuracy: 0.862600 Epoch 12, CIFAR-10 Batch 34: Loss: 0.5722 Validation Accuracy: 0.818600 Epoch 12, CIFAR-10 Batch 35: Loss: 0.4616 Validation Accuracy: 0.856800 Epoch 12, CIFAR-10 Batch 36: Loss: 0.4225 Validation Accuracy: 0.839400 Epoch 12, CIFAR-10 Batch 37: Loss: 0.3034 Validation Accuracy: 0.856200 Epoch 12, CIFAR-10 Batch 38: Loss: 0.2087 Validation Accuracy: 0.861000 Epoch 12, CIFAR-10 Batch 39: Loss: 0.2122 Validation Accuracy: 0.855800 Epoch 12, CIFAR-10 Batch 40: Loss: 0.4362 Validation Accuracy: 0.845400 Epoch 12, CIFAR-10 Batch 41: Loss: 0.2627 Validation Accuracy: 0.844800 Epoch 12, CIFAR-10 Batch 42: Loss: 0.3401 Validation Accuracy: 0.871400 Epoch 12, CIFAR-10 Batch 43: Loss: 0.4008 Validation Accuracy: 0.865200 Epoch 12, CIFAR-10 Batch 44: Loss: 0.3243 Validation Accuracy: 0.845800 Epoch 12, CIFAR-10 Batch 45: Loss: 0.3718 Validation Accuracy: 0.860400 Epoch 12, CIFAR-10 Batch 46: Loss: 0.3943 Validation Accuracy: 0.862800 Epoch 12, CIFAR-10 Batch 47: Loss: 0.2431 Validation Accuracy: 0.865200 Epoch 12, CIFAR-10 Batch 48: Loss: 0.3493 Validation Accuracy: 0.835400 Epoch 12, CIFAR-10 Batch 49: Loss: 0.4225 Validation Accuracy: 0.860400 Epoch 12, CIFAR-10 Batch 50: Loss: 0.3436 Validation Accuracy: 0.858600 Epoch 13, CIFAR-10 Batch 1: Loss: 0.2709 Validation Accuracy: 0.860000 Epoch 13, CIFAR-10 Batch 2: Loss: 0.2715 Validation Accuracy: 0.834000 Epoch 13, CIFAR-10 Batch 3: Loss: 0.2381 Validation Accuracy: 0.860000 Epoch 13, CIFAR-10 Batch 4: Loss: 0.2170 Validation Accuracy: 0.843800 Epoch 13, CIFAR-10 Batch 5: Loss: 0.3674 Validation Accuracy: 0.845000 Epoch 13, CIFAR-10 Batch 6: Loss: 0.5540 Validation Accuracy: 0.835000 Epoch 13, CIFAR-10 Batch 7: Loss: 0.2490 Validation Accuracy: 0.858800 Epoch 13, CIFAR-10 Batch 8: Loss: 0.4656 Validation Accuracy: 0.861200 Epoch 13, CIFAR-10 Batch 9: Loss: 0.4005 Validation Accuracy: 0.855200 Epoch 13, CIFAR-10 Batch 10: Loss: 0.2023 Validation Accuracy: 0.855000 Epoch 13, CIFAR-10 Batch 11: Loss: 0.3553 Validation Accuracy: 0.845800 Epoch 13, CIFAR-10 Batch 12: Loss: 0.4087 Validation Accuracy: 0.855600 Epoch 13, CIFAR-10 Batch 13: Loss: 0.4130 Validation Accuracy: 0.839000 Epoch 13, CIFAR-10 Batch 14: Loss: 0.3762 Validation Accuracy: 0.859200 Epoch 13, CIFAR-10 Batch 15: Loss: 0.2696 Validation Accuracy: 0.860400 Epoch 13, CIFAR-10 Batch 16: Loss: 0.3102 Validation Accuracy: 0.856200 Epoch 13, CIFAR-10 Batch 17: Loss: 0.5722 Validation Accuracy: 0.864800 Epoch 13, CIFAR-10 Batch 18: Loss: 0.2609 Validation Accuracy: 0.866400 Epoch 13, CIFAR-10 Batch 19: Loss: 0.2327 Validation Accuracy: 0.857600 Epoch 13, CIFAR-10 Batch 20: Loss: 0.4147 Validation Accuracy: 0.856200 Epoch 13, CIFAR-10 Batch 21: Loss: 0.3292 Validation Accuracy: 0.841800 Epoch 13, CIFAR-10 Batch 22: Loss: 0.3052 Validation Accuracy: 0.851800 Epoch 13, CIFAR-10 Batch 23: Loss: 0.3826 Validation Accuracy: 0.837800 Epoch 13, CIFAR-10 Batch 24: Loss: 0.3708 Validation Accuracy: 0.859600 Epoch 13, CIFAR-10 Batch 25: Loss: 0.3156 Validation Accuracy: 0.863400 Epoch 13, CIFAR-10 Batch 26: Loss: 0.2820 Validation Accuracy: 0.864200 Epoch 13, CIFAR-10 Batch 27: Loss: 0.2260 Validation Accuracy: 0.846000 Epoch 13, CIFAR-10 Batch 28: Loss: 0.5134 Validation Accuracy: 0.861200 Epoch 13, CIFAR-10 Batch 29: Loss: 0.3591 Validation Accuracy: 0.845200 Epoch 13, CIFAR-10 Batch 30: Loss: 0.1954 Validation Accuracy: 0.855000 Epoch 13, CIFAR-10 Batch 31: Loss: 0.2511 Validation Accuracy: 0.846800 Epoch 13, CIFAR-10 Batch 32: Loss: 0.2587 Validation Accuracy: 0.847000 Epoch 13, CIFAR-10 Batch 33: Loss: 0.5337 Validation Accuracy: 0.848000 Epoch 13, CIFAR-10 Batch 34: Loss: 0.5001 Validation Accuracy: 0.833000 Epoch 13, CIFAR-10 Batch 35: Loss: 0.4173 Validation Accuracy: 0.854000 Epoch 13, CIFAR-10 Batch 36: Loss: 0.3981 Validation Accuracy: 0.836200 Epoch 13, CIFAR-10 Batch 37: Loss: 0.2929 Validation Accuracy: 0.847000 Epoch 13, CIFAR-10 Batch 38: Loss: 0.1747 Validation Accuracy: 0.845000 Epoch 13, CIFAR-10 Batch 39: Loss: 0.1872 Validation Accuracy: 0.834400 Epoch 13, CIFAR-10 Batch 40: Loss: 0.4760 Validation Accuracy: 0.844600 Epoch 13, CIFAR-10 Batch 41: Loss: 0.2751 Validation Accuracy: 0.842400 Epoch 13, CIFAR-10 Batch 42: Loss: 0.3197 Validation Accuracy: 0.869600 Epoch 13, CIFAR-10 Batch 43: Loss: 0.3658 Validation Accuracy: 0.874000 Epoch 13, CIFAR-10 Batch 44: Loss: 0.3782 Validation Accuracy: 0.863400 Epoch 13, CIFAR-10 Batch 45: Loss: 0.3529 Validation Accuracy: 0.855000 Epoch 13, CIFAR-10 Batch 46: Loss: 0.3891 Validation Accuracy: 0.855000 Epoch 13, CIFAR-10 Batch 47: Loss: 0.2919 Validation Accuracy: 0.850600 Epoch 13, CIFAR-10 Batch 48: Loss: 0.3230 Validation Accuracy: 0.870600 Epoch 13, CIFAR-10 Batch 49: Loss: 0.3613 Validation Accuracy: 0.848000 Epoch 13, CIFAR-10 Batch 50: Loss: 0.3062 Validation Accuracy: 0.868200 Epoch 14, CIFAR-10 Batch 1: Loss: 0.2791 Validation Accuracy: 0.864000 Epoch 14, CIFAR-10 Batch 2: Loss: 0.2792 Validation Accuracy: 0.848000 Epoch 14, CIFAR-10 Batch 3: Loss: 0.2678 Validation Accuracy: 0.873600 Epoch 14, CIFAR-10 Batch 4: Loss: 0.2404 Validation Accuracy: 0.863000 Epoch 14, CIFAR-10 Batch 5: Loss: 0.3194 Validation Accuracy: 0.849200 Epoch 14, CIFAR-10 Batch 6: Loss: 0.5063 Validation Accuracy: 0.860000 Epoch 14, CIFAR-10 Batch 7: Loss: 0.2422 Validation Accuracy: 0.849400 Epoch 14, CIFAR-10 Batch 8: Loss: 0.3905 Validation Accuracy: 0.854400 Epoch 14, CIFAR-10 Batch 9: Loss: 0.3814 Validation Accuracy: 0.856600 Epoch 14, CIFAR-10 Batch 10: Loss: 0.1842 Validation Accuracy: 0.857200 Epoch 14, CIFAR-10 Batch 11: Loss: 0.3414 Validation Accuracy: 0.864200 Epoch 14, CIFAR-10 Batch 12: Loss: 0.3486 Validation Accuracy: 0.866800 Epoch 14, CIFAR-10 Batch 13: Loss: 0.4136 Validation Accuracy: 0.828600 Epoch 14, CIFAR-10 Batch 14: Loss: 0.3231 Validation Accuracy: 0.852800 Epoch 14, CIFAR-10 Batch 15: Loss: 0.3387 Validation Accuracy: 0.867200 Epoch 14, CIFAR-10 Batch 16: Loss: 0.2153 Validation Accuracy: 0.799400 Epoch 14, CIFAR-10 Batch 17: Loss: 0.5469 Validation Accuracy: 0.869200 Epoch 14, CIFAR-10 Batch 18: Loss: 0.2853 Validation Accuracy: 0.853000 Epoch 14, CIFAR-10 Batch 19: Loss: 0.2824 Validation Accuracy: 0.857400 Epoch 14, CIFAR-10 Batch 20: Loss: 0.5016 Validation Accuracy: 0.843400 Epoch 14, CIFAR-10 Batch 21: Loss: 0.3532 Validation Accuracy: 0.857200 Epoch 14, CIFAR-10 Batch 22: Loss: 0.3404 Validation Accuracy: 0.865400 Epoch 14, CIFAR-10 Batch 23: Loss: 0.3870 Validation Accuracy: 0.855000 Epoch 14, CIFAR-10 Batch 24: Loss: 0.3529 Validation Accuracy: 0.857600 Epoch 14, CIFAR-10 Batch 25: Loss: 0.3110 Validation Accuracy: 0.841000 Epoch 14, CIFAR-10 Batch 26: Loss: 0.2503 Validation Accuracy: 0.869600 Epoch 14, CIFAR-10 Batch 27: Loss: 0.1934 Validation Accuracy: 0.845400 Epoch 14, CIFAR-10 Batch 28: Loss: 0.4501 Validation Accuracy: 0.853400 Epoch 14, CIFAR-10 Batch 29: Loss: 0.2983 Validation Accuracy: 0.851200 Epoch 14, CIFAR-10 Batch 30: Loss: 0.1832 Validation Accuracy: 0.857000 Epoch 14, CIFAR-10 Batch 31: Loss: 0.2903 Validation Accuracy: 0.852600 Epoch 14, CIFAR-10 Batch 32: Loss: 0.2708 Validation Accuracy: 0.861800 Epoch 14, CIFAR-10 Batch 33: Loss: 0.4279 Validation Accuracy: 0.863400 Epoch 14, CIFAR-10 Batch 34: Loss: 0.5495 Validation Accuracy: 0.837600 Epoch 14, CIFAR-10 Batch 35: Loss: 0.3781 Validation Accuracy: 0.862800 Epoch 14, CIFAR-10 Batch 36: Loss: 0.4073 Validation Accuracy: 0.815000 Epoch 14, CIFAR-10 Batch 37: Loss: 0.2305 Validation Accuracy: 0.865800 Epoch 14, CIFAR-10 Batch 38: Loss: 0.1875 Validation Accuracy: 0.847600 Epoch 14, CIFAR-10 Batch 39: Loss: 0.1696 Validation Accuracy: 0.849400 Epoch 14, CIFAR-10 Batch 40: Loss: 0.3729 Validation Accuracy: 0.865600 Epoch 14, CIFAR-10 Batch 41: Loss: 0.2935 Validation Accuracy: 0.853000 Epoch 14, CIFAR-10 Batch 42: Loss: 0.2967 Validation Accuracy: 0.862400 Epoch 14, CIFAR-10 Batch 43: Loss: 0.3791 Validation Accuracy: 0.870400 Epoch 14, CIFAR-10 Batch 44: Loss: 0.3377 Validation Accuracy: 0.868800 Epoch 14, CIFAR-10 Batch 45: Loss: 0.3852 Validation Accuracy: 0.859000 Epoch 14, CIFAR-10 Batch 46: Loss: 0.3787 Validation Accuracy: 0.854200 Epoch 14, CIFAR-10 Batch 47: Loss: 0.3250 Validation Accuracy: 0.859200 Epoch 14, CIFAR-10 Batch 48: Loss: 0.3271 Validation Accuracy: 0.838000 Epoch 14, CIFAR-10 Batch 49: Loss: 0.2935 Validation Accuracy: 0.871000 Epoch 14, CIFAR-10 Batch 50: Loss: 0.2752 Validation Accuracy: 0.844800 Epoch 15, CIFAR-10 Batch 1: Loss: 0.3218 Validation Accuracy: 0.871600 Epoch 15, CIFAR-10 Batch 2: Loss: 0.2373 Validation Accuracy: 0.866400 Epoch 15, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.865400 Epoch 15, CIFAR-10 Batch 4: Loss: 0.2461 Validation Accuracy: 0.850000 Epoch 15, CIFAR-10 Batch 5: Loss: 0.2957 Validation Accuracy: 0.850600 Epoch 15, CIFAR-10 Batch 6: Loss: 0.4380 Validation Accuracy: 0.865600 Epoch 15, CIFAR-10 Batch 7: Loss: 0.2947 Validation Accuracy: 0.847000 Epoch 15, CIFAR-10 Batch 8: Loss: 0.3224 Validation Accuracy: 0.856400 Epoch 15, CIFAR-10 Batch 9: Loss: 0.3488 Validation Accuracy: 0.857400 Epoch 15, CIFAR-10 Batch 10: Loss: 0.2166 Validation Accuracy: 0.860600 Epoch 15, CIFAR-10 Batch 11: Loss: 0.3076 Validation Accuracy: 0.855600 Epoch 15, CIFAR-10 Batch 12: Loss: 0.4517 Validation Accuracy: 0.841200 Epoch 15, CIFAR-10 Batch 13: Loss: 0.3066 Validation Accuracy: 0.856600 Epoch 15, CIFAR-10 Batch 14: Loss: 0.3906 Validation Accuracy: 0.850400 Epoch 15, CIFAR-10 Batch 15: Loss: 0.3357 Validation Accuracy: 0.855200 Epoch 15, CIFAR-10 Batch 16: Loss: 0.2748 Validation Accuracy: 0.846000 Epoch 15, CIFAR-10 Batch 17: Loss: 0.5228 Validation Accuracy: 0.859600 Epoch 15, CIFAR-10 Batch 18: Loss: 0.2792 Validation Accuracy: 0.839600 Epoch 15, CIFAR-10 Batch 19: Loss: 0.2425 Validation Accuracy: 0.866800 Epoch 15, CIFAR-10 Batch 20: Loss: 0.3899 Validation Accuracy: 0.861800 Epoch 15, CIFAR-10 Batch 21: Loss: 0.3178 Validation Accuracy: 0.858200 Epoch 15, CIFAR-10 Batch 22: Loss: 0.3282 Validation Accuracy: 0.855000 Epoch 15, CIFAR-10 Batch 23: Loss: 0.3688 Validation Accuracy: 0.860400 Epoch 15, CIFAR-10 Batch 24: Loss: 0.3248 Validation Accuracy: 0.860000 Epoch 15, CIFAR-10 Batch 25: Loss: 0.3402 Validation Accuracy: 0.860600 Epoch 15, CIFAR-10 Batch 26: Loss: 0.2351 Validation Accuracy: 0.872000 Epoch 15, CIFAR-10 Batch 27: Loss: 0.1863 Validation Accuracy: 0.838000 Epoch 15, CIFAR-10 Batch 28: Loss: 0.3803 Validation Accuracy: 0.853800 Epoch 15, CIFAR-10 Batch 29: Loss: 0.2668 Validation Accuracy: 0.868800 Epoch 15, CIFAR-10 Batch 30: Loss: 0.2038 Validation Accuracy: 0.855200 Epoch 15, CIFAR-10 Batch 31: Loss: 0.2916 Validation Accuracy: 0.829400 Epoch 15, CIFAR-10 Batch 32: Loss: 0.2110 Validation Accuracy: 0.847600 Epoch 15, CIFAR-10 Batch 33: Loss: 0.4758 Validation Accuracy: 0.817400 Epoch 15, CIFAR-10 Batch 34: Loss: 0.5414 Validation Accuracy: 0.839400 Epoch 15, CIFAR-10 Batch 35: Loss: 0.4139 Validation Accuracy: 0.863400 Epoch 15, CIFAR-10 Batch 36: Loss: 0.3946 Validation Accuracy: 0.850000 Epoch 15, CIFAR-10 Batch 37: Loss: 0.2285 Validation Accuracy: 0.862400 Epoch 15, CIFAR-10 Batch 38: Loss: 0.1937 Validation Accuracy: 0.827600 Epoch 15, CIFAR-10 Batch 39: Loss: 0.2121 Validation Accuracy: 0.847800 Epoch 15, CIFAR-10 Batch 40: Loss: 0.4419 Validation Accuracy: 0.848200 Epoch 15, CIFAR-10 Batch 41: Loss: 0.2971 Validation Accuracy: 0.836200 Epoch 15, CIFAR-10 Batch 42: Loss: 0.3402 Validation Accuracy: 0.864000 Epoch 15, CIFAR-10 Batch 43: Loss: 0.4027 Validation Accuracy: 0.867600 Epoch 15, CIFAR-10 Batch 44: Loss: 0.3334 Validation Accuracy: 0.873000 Epoch 15, CIFAR-10 Batch 45: Loss: 0.3311 Validation Accuracy: 0.862000 Epoch 15, CIFAR-10 Batch 46: Loss: 0.3511 Validation Accuracy: 0.858600 Epoch 15, CIFAR-10 Batch 47: Loss: 0.2422 Validation Accuracy: 0.871600 Epoch 15, CIFAR-10 Batch 48: Loss: 0.3588 Validation Accuracy: 0.857600 Epoch 15, CIFAR-10 Batch 49: Loss: 0.3872 Validation Accuracy: 0.853800 Epoch 15, CIFAR-10 Batch 50: Loss: 0.3263 Validation Accuracy: 0.852600 Epoch 16, CIFAR-10 Batch 1: Loss: 0.2408 Validation Accuracy: 0.864000 Epoch 16, CIFAR-10 Batch 2: Loss: 0.1907 Validation Accuracy: 0.825200 Epoch 16, CIFAR-10 Batch 3: Loss: 0.2370 Validation Accuracy: 0.869000 Epoch 16, CIFAR-10 Batch 4: Loss: 0.1947 Validation Accuracy: 0.871800 Epoch 16, CIFAR-10 Batch 5: Loss: 0.3148 Validation Accuracy: 0.866000 Epoch 16, CIFAR-10 Batch 6: Loss: 0.5190 Validation Accuracy: 0.864600 Epoch 16, CIFAR-10 Batch 7: Loss: 0.2693 Validation Accuracy: 0.845800 Epoch 16, CIFAR-10 Batch 8: Loss: 0.3770 Validation Accuracy: 0.854400 Epoch 16, CIFAR-10 Batch 9: Loss: 0.3521 Validation Accuracy: 0.859400 Epoch 16, CIFAR-10 Batch 10: Loss: 0.2543 Validation Accuracy: 0.848600 Epoch 16, CIFAR-10 Batch 11: Loss: 0.3737 Validation Accuracy: 0.865800 Epoch 16, CIFAR-10 Batch 12: Loss: 0.3715 Validation Accuracy: 0.859200 Epoch 16, CIFAR-10 Batch 13: Loss: 0.3234 Validation Accuracy: 0.860600 Epoch 16, CIFAR-10 Batch 14: Loss: 0.3555 Validation Accuracy: 0.852200 Epoch 16, CIFAR-10 Batch 15: Loss: 0.3452 Validation Accuracy: 0.850200 Epoch 16, CIFAR-10 Batch 16: Loss: 0.2873 Validation Accuracy: 0.869600 Epoch 16, CIFAR-10 Batch 17: Loss: 0.4437 Validation Accuracy: 0.872200 Epoch 16, CIFAR-10 Batch 18: Loss: 0.2927 Validation Accuracy: 0.854400 Epoch 16, CIFAR-10 Batch 19: Loss: 0.2225 Validation Accuracy: 0.860800 Epoch 16, CIFAR-10 Batch 20: Loss: 0.3912 Validation Accuracy: 0.857400 Epoch 16, CIFAR-10 Batch 21: Loss: 0.3107 Validation Accuracy: 0.854800 Epoch 16, CIFAR-10 Batch 22: Loss: 0.2803 Validation Accuracy: 0.850200 Epoch 16, CIFAR-10 Batch 23: Loss: 0.3545 Validation Accuracy: 0.852800 Epoch 16, CIFAR-10 Batch 24: Loss: 0.3563 Validation Accuracy: 0.867000 Epoch 16, CIFAR-10 Batch 25: Loss: 0.2713 Validation Accuracy: 0.868000 Epoch 16, CIFAR-10 Batch 26: Loss: 0.2644 Validation Accuracy: 0.877600 Epoch 16, CIFAR-10 Batch 27: Loss: 0.2128 Validation Accuracy: 0.816000 Epoch 16, CIFAR-10 Batch 28: Loss: 0.3570 Validation Accuracy: 0.871600 Epoch 16, CIFAR-10 Batch 29: Loss: 0.2173 Validation Accuracy: 0.850600 Epoch 16, CIFAR-10 Batch 30: Loss: 0.1682 Validation Accuracy: 0.858600 Epoch 16, CIFAR-10 Batch 31: Loss: 0.2705 Validation Accuracy: 0.838800 Epoch 16, CIFAR-10 Batch 32: Loss: 0.2363 Validation Accuracy: 0.844200 Epoch 16, CIFAR-10 Batch 33: Loss: 0.4148 Validation Accuracy: 0.863800 Epoch 16, CIFAR-10 Batch 34: Loss: 0.4942 Validation Accuracy: 0.863800 Epoch 16, CIFAR-10 Batch 35: Loss: 0.4485 Validation Accuracy: 0.875800 Epoch 16, CIFAR-10 Batch 36: Loss: 0.3413 Validation Accuracy: 0.823200 Epoch 16, CIFAR-10 Batch 37: Loss: 0.1994 Validation Accuracy: 0.849800 Epoch 16, CIFAR-10 Batch 38: Loss: 0.1989 Validation Accuracy: 0.853800 Epoch 16, CIFAR-10 Batch 39: Loss: 0.1989 Validation Accuracy: 0.844600 Epoch 16, CIFAR-10 Batch 40: Loss: 0.3461 Validation Accuracy: 0.841000 Epoch 16, CIFAR-10 Batch 41: Loss: 0.2904 Validation Accuracy: 0.849800 Epoch 16, CIFAR-10 Batch 42: Loss: 0.3035 Validation Accuracy: 0.862800 Epoch 16, CIFAR-10 Batch 43: Loss: 0.3617 Validation Accuracy: 0.839200 Epoch 16, CIFAR-10 Batch 44: Loss: 0.3431 Validation Accuracy: 0.867000 Epoch 16, CIFAR-10 Batch 45: Loss: 0.3231 Validation Accuracy: 0.870000 Epoch 16, CIFAR-10 Batch 46: Loss: 0.3795 Validation Accuracy: 0.865200 Epoch 16, CIFAR-10 Batch 47: Loss: 0.2975 Validation Accuracy: 0.859400 Epoch 16, CIFAR-10 Batch 48: Loss: 0.2816 Validation Accuracy: 0.860200 Epoch 16, CIFAR-10 Batch 49: Loss: 0.3768 Validation Accuracy: 0.867400 Epoch 16, CIFAR-10 Batch 50: Loss: 0.2805 Validation Accuracy: 0.863000 Epoch 17, CIFAR-10 Batch 1: Loss: 0.2778 Validation Accuracy: 0.856000 Epoch 17, CIFAR-10 Batch 2: Loss: 0.2279 Validation Accuracy: 0.857200 Epoch 17, CIFAR-10 Batch 3: Loss: 0.2462 Validation Accuracy: 0.860000 Epoch 17, CIFAR-10 Batch 4: Loss: 0.2298 Validation Accuracy: 0.858000 Epoch 17, CIFAR-10 Batch 5: Loss: 0.3216 Validation Accuracy: 0.846000 Epoch 17, CIFAR-10 Batch 6: Loss: 0.4038 Validation Accuracy: 0.871600 Epoch 17, CIFAR-10 Batch 7: Loss: 0.2758 Validation Accuracy: 0.854200 Epoch 17, CIFAR-10 Batch 8: Loss: 0.3659 Validation Accuracy: 0.870600 Epoch 17, CIFAR-10 Batch 9: Loss: 0.3812 Validation Accuracy: 0.858800 Epoch 17, CIFAR-10 Batch 10: Loss: 0.1588 Validation Accuracy: 0.856600 Epoch 17, CIFAR-10 Batch 11: Loss: 0.3428 Validation Accuracy: 0.839600 Epoch 17, CIFAR-10 Batch 12: Loss: 0.3710 Validation Accuracy: 0.857200 Epoch 17, CIFAR-10 Batch 13: Loss: 0.3321 Validation Accuracy: 0.838400 Epoch 17, CIFAR-10 Batch 14: Loss: 0.3012 Validation Accuracy: 0.841800 Epoch 17, CIFAR-10 Batch 15: Loss: 0.2507 Validation Accuracy: 0.857600 Epoch 17, CIFAR-10 Batch 16: Loss: 0.2700 Validation Accuracy: 0.854600 Epoch 17, CIFAR-10 Batch 17: Loss: 0.5268 Validation Accuracy: 0.861600 Epoch 17, CIFAR-10 Batch 18: Loss: 0.3709 Validation Accuracy: 0.849600 Epoch 17, CIFAR-10 Batch 19: Loss: 0.1880 Validation Accuracy: 0.865400 Epoch 17, CIFAR-10 Batch 20: Loss: 0.3928 Validation Accuracy: 0.858000 Epoch 17, CIFAR-10 Batch 21: Loss: 0.3002 Validation Accuracy: 0.845400 Epoch 17, CIFAR-10 Batch 22: Loss: 0.2694 Validation Accuracy: 0.858600 Epoch 17, CIFAR-10 Batch 23: Loss: 0.3533 Validation Accuracy: 0.861400 Epoch 17, CIFAR-10 Batch 24: Loss: 0.2833 Validation Accuracy: 0.867800 Epoch 17, CIFAR-10 Batch 25: Loss: 0.3065 Validation Accuracy: 0.854400 Epoch 17, CIFAR-10 Batch 26: Loss: 0.2620 Validation Accuracy: 0.873400 Epoch 17, CIFAR-10 Batch 27: Loss: 0.1828 Validation Accuracy: 0.849600 Epoch 17, CIFAR-10 Batch 28: Loss: 0.3688 Validation Accuracy: 0.866800 Epoch 17, CIFAR-10 Batch 29: Loss: 0.2682 Validation Accuracy: 0.867200 Epoch 17, CIFAR-10 Batch 30: Loss: 0.1651 Validation Accuracy: 0.851800 Epoch 17, CIFAR-10 Batch 31: Loss: 0.2892 Validation Accuracy: 0.853600 Epoch 17, CIFAR-10 Batch 32: Loss: 0.2094 Validation Accuracy: 0.866400 Epoch 17, CIFAR-10 Batch 33: Loss: 0.5019 Validation Accuracy: 0.837200 Epoch 17, CIFAR-10 Batch 34: Loss: 0.4898 Validation Accuracy: 0.829800 Epoch 17, CIFAR-10 Batch 35: Loss: 0.4422 Validation Accuracy: 0.871000 Epoch 17, CIFAR-10 Batch 36: Loss: 0.3139 Validation Accuracy: 0.847000 Epoch 17, CIFAR-10 Batch 37: Loss: 0.2503 Validation Accuracy: 0.860600 Epoch 17, CIFAR-10 Batch 38: Loss: 0.1950 Validation Accuracy: 0.872800 Epoch 17, CIFAR-10 Batch 39: Loss: 0.2157 Validation Accuracy: 0.854200 Epoch 17, CIFAR-10 Batch 40: Loss: 0.3170 Validation Accuracy: 0.842800 Epoch 17, CIFAR-10 Batch 41: Loss: 0.2273 Validation Accuracy: 0.834800 Epoch 17, CIFAR-10 Batch 42: Loss: 0.2480 Validation Accuracy: 0.868200 Epoch 17, CIFAR-10 Batch 43: Loss: 0.3837 Validation Accuracy: 0.862200 Epoch 17, CIFAR-10 Batch 44: Loss: 0.2685 Validation Accuracy: 0.872400 Epoch 17, CIFAR-10 Batch 45: Loss: 0.2657 Validation Accuracy: 0.864600 Epoch 17, CIFAR-10 Batch 46: Loss: 0.3773 Validation Accuracy: 0.851400 Epoch 17, CIFAR-10 Batch 47: Loss: 0.2236 Validation Accuracy: 0.853200 Epoch 17, CIFAR-10 Batch 48: Loss: 0.3380 Validation Accuracy: 0.854200 Epoch 17, CIFAR-10 Batch 49: Loss: 0.2767 Validation Accuracy: 0.873000 Epoch 17, CIFAR-10 Batch 50: Loss: 0.2575 Validation Accuracy: 0.834800 Epoch 18, CIFAR-10 Batch 1: Loss: 0.2551 Validation Accuracy: 0.856800 Epoch 18, CIFAR-10 Batch 2: Loss: 0.2795 Validation Accuracy: 0.861600 Epoch 18, CIFAR-10 Batch 3: Loss: 0.2398 Validation Accuracy: 0.872000 Epoch 18, CIFAR-10 Batch 4: Loss: 0.2068 Validation Accuracy: 0.852400 Epoch 18, CIFAR-10 Batch 5: Loss: 0.2558 Validation Accuracy: 0.858600 Epoch 18, CIFAR-10 Batch 6: Loss: 0.4525 Validation Accuracy: 0.872000 Epoch 18, CIFAR-10 Batch 7: Loss: 0.2320 Validation Accuracy: 0.857200 Epoch 18, CIFAR-10 Batch 8: Loss: 0.4307 Validation Accuracy: 0.864800 Epoch 18, CIFAR-10 Batch 9: Loss: 0.3007 Validation Accuracy: 0.870400 Epoch 18, CIFAR-10 Batch 10: Loss: 0.1605 Validation Accuracy: 0.861200 Epoch 18, CIFAR-10 Batch 11: Loss: 0.2691 Validation Accuracy: 0.848600 Epoch 18, CIFAR-10 Batch 12: Loss: 0.3393 Validation Accuracy: 0.863000 Epoch 18, CIFAR-10 Batch 13: Loss: 0.3636 Validation Accuracy: 0.860600 Epoch 18, CIFAR-10 Batch 14: Loss: 0.3100 Validation Accuracy: 0.852000 Epoch 18, CIFAR-10 Batch 15: Loss: 0.2536 Validation Accuracy: 0.846600 Epoch 18, CIFAR-10 Batch 16: Loss: 0.2357 Validation Accuracy: 0.868400 Epoch 18, CIFAR-10 Batch 17: Loss: 0.4504 Validation Accuracy: 0.873400 Epoch 18, CIFAR-10 Batch 18: Loss: 0.2343 Validation Accuracy: 0.861400 Epoch 18, CIFAR-10 Batch 19: Loss: 0.2210 Validation Accuracy: 0.864000 Epoch 18, CIFAR-10 Batch 20: Loss: 0.3470 Validation Accuracy: 0.872200 Epoch 18, CIFAR-10 Batch 21: Loss: 0.3320 Validation Accuracy: 0.869600 Epoch 18, CIFAR-10 Batch 22: Loss: 0.2969 Validation Accuracy: 0.866800 Epoch 18, CIFAR-10 Batch 23: Loss: 0.3941 Validation Accuracy: 0.865000 Epoch 18, CIFAR-10 Batch 24: Loss: 0.2905 Validation Accuracy: 0.873800 Epoch 18, CIFAR-10 Batch 25: Loss: 0.2312 Validation Accuracy: 0.868600 Epoch 18, CIFAR-10 Batch 26: Loss: 0.2766 Validation Accuracy: 0.849800 Epoch 18, CIFAR-10 Batch 27: Loss: 0.1623 Validation Accuracy: 0.855000 Epoch 18, CIFAR-10 Batch 28: Loss: 0.3482 Validation Accuracy: 0.864400 Epoch 18, CIFAR-10 Batch 29: Loss: 0.2252 Validation Accuracy: 0.872800 Epoch 18, CIFAR-10 Batch 30: Loss: 0.1647 Validation Accuracy: 0.869400 Epoch 18, CIFAR-10 Batch 31: Loss: 0.2364 Validation Accuracy: 0.852600 Epoch 18, CIFAR-10 Batch 32: Loss: 0.2047 Validation Accuracy: 0.845400 Epoch 18, CIFAR-10 Batch 33: Loss: 0.4592 Validation Accuracy: 0.844000 Epoch 18, CIFAR-10 Batch 34: Loss: 0.5665 Validation Accuracy: 0.849200 Epoch 18, CIFAR-10 Batch 35: Loss: 0.3656 Validation Accuracy: 0.871000 Epoch 18, CIFAR-10 Batch 36: Loss: 0.3534 Validation Accuracy: 0.839600 Epoch 18, CIFAR-10 Batch 37: Loss: 0.2481 Validation Accuracy: 0.871600 Epoch 18, CIFAR-10 Batch 38: Loss: 0.1800 Validation Accuracy: 0.871200 Epoch 18, CIFAR-10 Batch 39: Loss: 0.1882 Validation Accuracy: 0.859000 Epoch 18, CIFAR-10 Batch 40: Loss: 0.3001 Validation Accuracy: 0.855600 Epoch 18, CIFAR-10 Batch 41: Loss: 0.2765 Validation Accuracy: 0.843000 Epoch 18, CIFAR-10 Batch 42: Loss: 0.3333 Validation Accuracy: 0.870600 Epoch 18, CIFAR-10 Batch 43: Loss: 0.3523 Validation Accuracy: 0.869400 Epoch 18, CIFAR-10 Batch 44: Loss: 0.2911 Validation Accuracy: 0.854400 Epoch 18, CIFAR-10 Batch 45: Loss: 0.3019 Validation Accuracy: 0.863000 Epoch 18, CIFAR-10 Batch 46: Loss: 0.3240 Validation Accuracy: 0.867800 Epoch 18, CIFAR-10 Batch 47: Loss: 0.2854 Validation Accuracy: 0.870000 Epoch 18, CIFAR-10 Batch 48: Loss: 0.2880 Validation Accuracy: 0.865000 Epoch 18, CIFAR-10 Batch 49: Loss: 0.3336 Validation Accuracy: 0.862200 Epoch 18, CIFAR-10 Batch 50: Loss: 0.2520 Validation Accuracy: 0.869200 Epoch 19, CIFAR-10 Batch 1: Loss: 0.2551 Validation Accuracy: 0.866600 Epoch 19, CIFAR-10 Batch 2: Loss: 0.2737 Validation Accuracy: 0.870200 Epoch 19, CIFAR-10 Batch 3: Loss: 0.2069 Validation Accuracy: 0.854000 Epoch 19, CIFAR-10 Batch 4: Loss: 0.2146 Validation Accuracy: 0.854200 Epoch 19, CIFAR-10 Batch 5: Loss: 0.2547 Validation Accuracy: 0.862200 Epoch 19, CIFAR-10 Batch 6: Loss: 0.4141 Validation Accuracy: 0.865800 Epoch 19, CIFAR-10 Batch 7: Loss: 0.2063 Validation Accuracy: 0.858400 Epoch 19, CIFAR-10 Batch 8: Loss: 0.4067 Validation Accuracy: 0.859600 Epoch 19, CIFAR-10 Batch 9: Loss: 0.2764 Validation Accuracy: 0.864400 Epoch 19, CIFAR-10 Batch 10: Loss: 0.1678 Validation Accuracy: 0.864600 Epoch 19, CIFAR-10 Batch 11: Loss: 0.2801 Validation Accuracy: 0.844200 Epoch 19, CIFAR-10 Batch 12: Loss: 0.3552 Validation Accuracy: 0.854400 Epoch 19, CIFAR-10 Batch 13: Loss: 0.2896 Validation Accuracy: 0.864800 Epoch 19, CIFAR-10 Batch 14: Loss: 0.3732 Validation Accuracy: 0.856600 Epoch 19, CIFAR-10 Batch 15: Loss: 0.2507 Validation Accuracy: 0.862600 Epoch 19, CIFAR-10 Batch 16: Loss: 0.2350 Validation Accuracy: 0.837600 Epoch 19, CIFAR-10 Batch 17: Loss: 0.4670 Validation Accuracy: 0.869000 Epoch 19, CIFAR-10 Batch 18: Loss: 0.2192 Validation Accuracy: 0.866600 Epoch 19, CIFAR-10 Batch 19: Loss: 0.1891 Validation Accuracy: 0.856200 Epoch 19, CIFAR-10 Batch 20: Loss: 0.3766 Validation Accuracy: 0.854600 Epoch 19, CIFAR-10 Batch 21: Loss: 0.3280 Validation Accuracy: 0.861000 Epoch 19, CIFAR-10 Batch 22: Loss: 0.2534 Validation Accuracy: 0.861800 Epoch 19, CIFAR-10 Batch 23: Loss: 0.3807 Validation Accuracy: 0.861400 Epoch 19, CIFAR-10 Batch 24: Loss: 0.3080 Validation Accuracy: 0.872200 Epoch 19, CIFAR-10 Batch 25: Loss: 0.3136 Validation Accuracy: 0.860400 Epoch 19, CIFAR-10 Batch 26: Loss: 0.2293 Validation Accuracy: 0.869600 Epoch 19, CIFAR-10 Batch 27: Loss: 0.1869 Validation Accuracy: 0.862800 Epoch 19, CIFAR-10 Batch 28: Loss: 0.3620 Validation Accuracy: 0.852200 Epoch 19, CIFAR-10 Batch 29: Loss: 0.2664 Validation Accuracy: 0.865400 Epoch 19, CIFAR-10 Batch 30: Loss: 0.1726 Validation Accuracy: 0.850400 Epoch 19, CIFAR-10 Batch 31: Loss: 0.2498 Validation Accuracy: 0.856200 Epoch 19, CIFAR-10 Batch 32: Loss: 0.1957 Validation Accuracy: 0.848800 Epoch 19, CIFAR-10 Batch 33: Loss: 0.4513 Validation Accuracy: 0.850400 Epoch 19, CIFAR-10 Batch 34: Loss: 0.4255 Validation Accuracy: 0.832200 Epoch 19, CIFAR-10 Batch 35: Loss: 0.4537 Validation Accuracy: 0.867200 Epoch 19, CIFAR-10 Batch 36: Loss: 0.3589 Validation Accuracy: 0.838000 Epoch 19, CIFAR-10 Batch 37: Loss: 0.2734 Validation Accuracy: 0.862000 Epoch 19, CIFAR-10 Batch 38: Loss: 0.1648 Validation Accuracy: 0.849200 Epoch 19, CIFAR-10 Batch 39: Loss: 0.2075 Validation Accuracy: 0.871600 Epoch 19, CIFAR-10 Batch 40: Loss: 0.3118 Validation Accuracy: 0.857400 Epoch 19, CIFAR-10 Batch 41: Loss: 0.2274 Validation Accuracy: 0.845000 Epoch 19, CIFAR-10 Batch 42: Loss: 0.2196 Validation Accuracy: 0.868400 Epoch 19, CIFAR-10 Batch 43: Loss: 0.3793 Validation Accuracy: 0.869600 Epoch 19, CIFAR-10 Batch 44: Loss: 0.3098 Validation Accuracy: 0.845600 Epoch 19, CIFAR-10 Batch 45: Loss: 0.2111 Validation Accuracy: 0.878400 Epoch 19, CIFAR-10 Batch 46: Loss: 0.3209 Validation Accuracy: 0.864800 Epoch 19, CIFAR-10 Batch 47: Loss: 0.2641 Validation Accuracy: 0.875600 Epoch 19, CIFAR-10 Batch 48: Loss: 0.2376 Validation Accuracy: 0.850400 Epoch 19, CIFAR-10 Batch 49: Loss: 0.3689 Validation Accuracy: 0.869200 Epoch 19, CIFAR-10 Batch 50: Loss: 0.2974 Validation Accuracy: 0.854000 Epoch 20, CIFAR-10 Batch 1: Loss: 0.2347 Validation Accuracy: 0.875000 Epoch 20, CIFAR-10 Batch 2: Loss: 0.2478 Validation Accuracy: 0.862400 Epoch 20, CIFAR-10 Batch 3: Loss: 0.1700 Validation Accuracy: 0.874200 Epoch 20, CIFAR-10 Batch 4: Loss: 0.1993 Validation Accuracy: 0.860000 Epoch 20, CIFAR-10 Batch 5: Loss: 0.2515 Validation Accuracy: 0.847600 Epoch 20, CIFAR-10 Batch 6: Loss: 0.4648 Validation Accuracy: 0.871600 Epoch 20, CIFAR-10 Batch 7: Loss: 0.2055 Validation Accuracy: 0.832600 Epoch 20, CIFAR-10 Batch 8: Loss: 0.3786 Validation Accuracy: 0.867800 Epoch 20, CIFAR-10 Batch 9: Loss: 0.2895 Validation Accuracy: 0.864200 Epoch 20, CIFAR-10 Batch 10: Loss: 0.1663 Validation Accuracy: 0.861200 Epoch 20, CIFAR-10 Batch 11: Loss: 0.2548 Validation Accuracy: 0.873400 Epoch 20, CIFAR-10 Batch 12: Loss: 0.3045 Validation Accuracy: 0.860200 Epoch 20, CIFAR-10 Batch 13: Loss: 0.3405 Validation Accuracy: 0.869000 Epoch 20, CIFAR-10 Batch 14: Loss: 0.3728 Validation Accuracy: 0.857400 Epoch 20, CIFAR-10 Batch 15: Loss: 0.2394 Validation Accuracy: 0.859600 Epoch 20, CIFAR-10 Batch 16: Loss: 0.2211 Validation Accuracy: 0.855600 Epoch 20, CIFAR-10 Batch 17: Loss: 0.5464 Validation Accuracy: 0.877600 Epoch 20, CIFAR-10 Batch 18: Loss: 0.2367 Validation Accuracy: 0.845200 Epoch 20, CIFAR-10 Batch 19: Loss: 0.1790 Validation Accuracy: 0.871800 Epoch 20, CIFAR-10 Batch 20: Loss: 0.3621 Validation Accuracy: 0.862800 Epoch 20, CIFAR-10 Batch 21: Loss: 0.2550 Validation Accuracy: 0.873000 Epoch 20, CIFAR-10 Batch 22: Loss: 0.2833 Validation Accuracy: 0.869400 Epoch 20, CIFAR-10 Batch 23: Loss: 0.3258 Validation Accuracy: 0.863800 Epoch 20, CIFAR-10 Batch 24: Loss: 0.3409 Validation Accuracy: 0.878000 Epoch 20, CIFAR-10 Batch 25: Loss: 0.2776 Validation Accuracy: 0.853600 Epoch 20, CIFAR-10 Batch 26: Loss: 0.2321 Validation Accuracy: 0.872200 Epoch 20, CIFAR-10 Batch 27: Loss: 0.2127 Validation Accuracy: 0.863800 Epoch 20, CIFAR-10 Batch 28: Loss: 0.3639 Validation Accuracy: 0.866400 Epoch 20, CIFAR-10 Batch 29: Loss: 0.2468 Validation Accuracy: 0.870600 Epoch 20, CIFAR-10 Batch 30: Loss: 0.1656 Validation Accuracy: 0.862800 Epoch 20, CIFAR-10 Batch 31: Loss: 0.2677 Validation Accuracy: 0.837600 Epoch 20, CIFAR-10 Batch 32: Loss: 0.1941 Validation Accuracy: 0.865000 Epoch 20, CIFAR-10 Batch 33: Loss: 0.3608 Validation Accuracy: 0.847200 Epoch 20, CIFAR-10 Batch 34: Loss: 0.3806 Validation Accuracy: 0.856400 Epoch 20, CIFAR-10 Batch 35: Loss: 0.3779 Validation Accuracy: 0.871600 Epoch 20, CIFAR-10 Batch 36: Loss: 0.2956 Validation Accuracy: 0.839400 Epoch 20, CIFAR-10 Batch 37: Loss: 0.2088 Validation Accuracy: 0.853800 Epoch 20, CIFAR-10 Batch 38: Loss: 0.1745 Validation Accuracy: 0.868400 Epoch 20, CIFAR-10 Batch 39: Loss: 0.2053 Validation Accuracy: 0.866200 Epoch 20, CIFAR-10 Batch 40: Loss: 0.2876 Validation Accuracy: 0.859400 Epoch 20, CIFAR-10 Batch 41: Loss: 0.2570 Validation Accuracy: 0.848000 Epoch 20, CIFAR-10 Batch 42: Loss: 0.2189 Validation Accuracy: 0.868200 Epoch 20, CIFAR-10 Batch 43: Loss: 0.3170 Validation Accuracy: 0.866600 Epoch 20, CIFAR-10 Batch 44: Loss: 0.3801 Validation Accuracy: 0.859400 Epoch 20, CIFAR-10 Batch 45: Loss: 0.2259 Validation Accuracy: 0.868400 Epoch 20, CIFAR-10 Batch 46: Loss: 0.3222 Validation Accuracy: 0.873000 Epoch 20, CIFAR-10 Batch 47: Loss: 0.2310 Validation Accuracy: 0.872600 Epoch 20, CIFAR-10 Batch 48: Loss: 0.2598 Validation Accuracy: 0.869000 Epoch 20, CIFAR-10 Batch 49: Loss: 0.3158 Validation Accuracy: 0.874400 Epoch 20, CIFAR-10 Batch 50: Loss: 0.3039 Validation Accuracy: 0.876200 Epoch 21, CIFAR-10 Batch 1: Loss: 0.2297 Validation Accuracy: 0.859200 Epoch 21, CIFAR-10 Batch 2: Loss: 0.2482 Validation Accuracy: 0.859800 Epoch 21, CIFAR-10 Batch 3: Loss: 0.1937 Validation Accuracy: 0.869000 Epoch 21, CIFAR-10 Batch 4: Loss: 0.2233 Validation Accuracy: 0.857800 Epoch 21, CIFAR-10 Batch 5: Loss: 0.2380 Validation Accuracy: 0.865400 Epoch 21, CIFAR-10 Batch 6: Loss: 0.3942 Validation Accuracy: 0.875000 Epoch 21, CIFAR-10 Batch 7: Loss: 0.2327 Validation Accuracy: 0.847200 Epoch 21, CIFAR-10 Batch 8: Loss: 0.3082 Validation Accuracy: 0.876000 Epoch 21, CIFAR-10 Batch 9: Loss: 0.2922 Validation Accuracy: 0.877600 Epoch 21, CIFAR-10 Batch 10: Loss: 0.1699 Validation Accuracy: 0.871200 Epoch 21, CIFAR-10 Batch 11: Loss: 0.2782 Validation Accuracy: 0.862600 Epoch 21, CIFAR-10 Batch 12: Loss: 0.2893 Validation Accuracy: 0.828800 Epoch 21, CIFAR-10 Batch 13: Loss: 0.2699 Validation Accuracy: 0.820600 Epoch 21, CIFAR-10 Batch 14: Loss: 0.3345 Validation Accuracy: 0.856400 Epoch 21, CIFAR-10 Batch 15: Loss: 0.2484 Validation Accuracy: 0.864200 Epoch 21, CIFAR-10 Batch 16: Loss: 0.2810 Validation Accuracy: 0.864400 Epoch 21, CIFAR-10 Batch 17: Loss: 0.4468 Validation Accuracy: 0.854200 Epoch 21, CIFAR-10 Batch 18: Loss: 0.1821 Validation Accuracy: 0.852400 Epoch 21, CIFAR-10 Batch 19: Loss: 0.2091 Validation Accuracy: 0.866400 Epoch 21, CIFAR-10 Batch 20: Loss: 0.3868 Validation Accuracy: 0.864800 Epoch 21, CIFAR-10 Batch 21: Loss: 0.2252 Validation Accuracy: 0.870400 Epoch 21, CIFAR-10 Batch 22: Loss: 0.3346 Validation Accuracy: 0.860800 Epoch 21, CIFAR-10 Batch 23: Loss: 0.3099 Validation Accuracy: 0.852400 Epoch 21, CIFAR-10 Batch 24: Loss: 0.2726 Validation Accuracy: 0.870000 Epoch 21, CIFAR-10 Batch 25: Loss: 0.2852 Validation Accuracy: 0.856200 Epoch 21, CIFAR-10 Batch 26: Loss: 0.1924 Validation Accuracy: 0.867200 Epoch 21, CIFAR-10 Batch 27: Loss: 0.2166 Validation Accuracy: 0.849000 Epoch 21, CIFAR-10 Batch 28: Loss: 0.3295 Validation Accuracy: 0.865400 Epoch 21, CIFAR-10 Batch 29: Loss: 0.2451 Validation Accuracy: 0.869400 Epoch 21, CIFAR-10 Batch 30: Loss: 0.1703 Validation Accuracy: 0.864000 Epoch 21, CIFAR-10 Batch 31: Loss: 0.2653 Validation Accuracy: 0.856400 Epoch 21, CIFAR-10 Batch 32: Loss: 0.2196 Validation Accuracy: 0.865600 Epoch 21, CIFAR-10 Batch 33: Loss: 0.4234 Validation Accuracy: 0.858800 Epoch 21, CIFAR-10 Batch 34: Loss: 0.4154 Validation Accuracy: 0.848200 Epoch 21, CIFAR-10 Batch 35: Loss: 0.3847 Validation Accuracy: 0.852000 Epoch 21, CIFAR-10 Batch 36: Loss: 0.3482 Validation Accuracy: 0.853600 Epoch 21, CIFAR-10 Batch 37: Loss: 0.2220 Validation Accuracy: 0.871200 Epoch 21, CIFAR-10 Batch 38: Loss: 0.1769 Validation Accuracy: 0.866200 Epoch 21, CIFAR-10 Batch 39: Loss: 0.2004 Validation Accuracy: 0.861600 Epoch 21, CIFAR-10 Batch 40: Loss: 0.2781 Validation Accuracy: 0.836800 Epoch 21, CIFAR-10 Batch 41: Loss: 0.2537 Validation Accuracy: 0.852200 Epoch 21, CIFAR-10 Batch 42: Loss: 0.2160 Validation Accuracy: 0.872200 Epoch 21, CIFAR-10 Batch 43: Loss: 0.3667 Validation Accuracy: 0.871200 Epoch 21, CIFAR-10 Batch 44: Loss: 0.2681 Validation Accuracy: 0.863200 Epoch 21, CIFAR-10 Batch 45: Loss: 0.2255 Validation Accuracy: 0.874800 Epoch 21, CIFAR-10 Batch 46: Loss: 0.3289 Validation Accuracy: 0.868600 Epoch 21, CIFAR-10 Batch 47: Loss: 0.1882 Validation Accuracy: 0.861000 Epoch 21, CIFAR-10 Batch 48: Loss: 0.2284 Validation Accuracy: 0.863600 Epoch 21, CIFAR-10 Batch 49: Loss: 0.3011 Validation Accuracy: 0.874600 Epoch 21, CIFAR-10 Batch 50: Loss: 0.2701 Validation Accuracy: 0.863600 Epoch 22, CIFAR-10 Batch 1: Loss: 0.2561 Validation Accuracy: 0.861200 Epoch 22, CIFAR-10 Batch 2: Loss: 0.2644 Validation Accuracy: 0.871200 Epoch 22, CIFAR-10 Batch 3: Loss: 0.1716 Validation Accuracy: 0.865800 Epoch 22, CIFAR-10 Batch 4: Loss: 0.2008 Validation Accuracy: 0.866600 Epoch 22, CIFAR-10 Batch 5: Loss: 0.2658 Validation Accuracy: 0.854800 Epoch 22, CIFAR-10 Batch 6: Loss: 0.3832 Validation Accuracy: 0.866800 Epoch 22, CIFAR-10 Batch 7: Loss: 0.1938 Validation Accuracy: 0.847000 Epoch 22, CIFAR-10 Batch 8: Loss: 0.3362 Validation Accuracy: 0.858400 Epoch 22, CIFAR-10 Batch 9: Loss: 0.2938 Validation Accuracy: 0.859000 Epoch 22, CIFAR-10 Batch 10: Loss: 0.1751 Validation Accuracy: 0.851800 Epoch 22, CIFAR-10 Batch 11: Loss: 0.2565 Validation Accuracy: 0.868000 Epoch 22, CIFAR-10 Batch 12: Loss: 0.3136 Validation Accuracy: 0.849200 Epoch 22, CIFAR-10 Batch 13: Loss: 0.3000 Validation Accuracy: 0.854400 Epoch 22, CIFAR-10 Batch 14: Loss: 0.2831 Validation Accuracy: 0.861600 Epoch 22, CIFAR-10 Batch 15: Loss: 0.2324 Validation Accuracy: 0.872200 Epoch 22, CIFAR-10 Batch 16: Loss: 0.2179 Validation Accuracy: 0.842800 Epoch 22, CIFAR-10 Batch 17: Loss: 0.4341 Validation Accuracy: 0.877400 Epoch 22, CIFAR-10 Batch 18: Loss: 0.2523 Validation Accuracy: 0.861600 Epoch 22, CIFAR-10 Batch 19: Loss: 0.2346 Validation Accuracy: 0.870000 Epoch 22, CIFAR-10 Batch 20: Loss: 0.3523 Validation Accuracy: 0.857400 Epoch 22, CIFAR-10 Batch 21: Loss: 0.2286 Validation Accuracy: 0.866600 Epoch 22, CIFAR-10 Batch 22: Loss: 0.2694 Validation Accuracy: 0.855200 Epoch 22, CIFAR-10 Batch 23: Loss: 0.3688 Validation Accuracy: 0.862000 Epoch 22, CIFAR-10 Batch 24: Loss: 0.3590 Validation Accuracy: 0.876200 Epoch 22, CIFAR-10 Batch 25: Loss: 0.2704 Validation Accuracy: 0.863200 Epoch 22, CIFAR-10 Batch 26: Loss: 0.2352 Validation Accuracy: 0.866800 Epoch 22, CIFAR-10 Batch 27: Loss: 0.2247 Validation Accuracy: 0.847000 Epoch 22, CIFAR-10 Batch 28: Loss: 0.3145 Validation Accuracy: 0.868400 Epoch 22, CIFAR-10 Batch 29: Loss: 0.2670 Validation Accuracy: 0.872200 Epoch 22, CIFAR-10 Batch 30: Loss: 0.1713 Validation Accuracy: 0.859000 Epoch 22, CIFAR-10 Batch 31: Loss: 0.2275 Validation Accuracy: 0.863600 Epoch 22, CIFAR-10 Batch 32: Loss: 0.2063 Validation Accuracy: 0.859800 Epoch 22, CIFAR-10 Batch 33: Loss: 0.3974 Validation Accuracy: 0.867800 Epoch 22, CIFAR-10 Batch 34: Loss: 0.3873 Validation Accuracy: 0.854600 Epoch 22, CIFAR-10 Batch 35: Loss: 0.3681 Validation Accuracy: 0.863400 Epoch 22, CIFAR-10 Batch 36: Loss: 0.3148 Validation Accuracy: 0.858200 Epoch 22, CIFAR-10 Batch 37: Loss: 0.2120 Validation Accuracy: 0.847400 Epoch 22, CIFAR-10 Batch 38: Loss: 0.1655 Validation Accuracy: 0.848600 Epoch 22, CIFAR-10 Batch 39: Loss: 0.1588 Validation Accuracy: 0.853000 Epoch 22, CIFAR-10 Batch 40: Loss: 0.2601 Validation Accuracy: 0.856200 Epoch 22, CIFAR-10 Batch 41: Loss: 0.2950 Validation Accuracy: 0.854000 Epoch 22, CIFAR-10 Batch 42: Loss: 0.3139 Validation Accuracy: 0.880000 Epoch 22, CIFAR-10 Batch 43: Loss: 0.4048 Validation Accuracy: 0.875000 Epoch 22, CIFAR-10 Batch 44: Loss: 0.2693 Validation Accuracy: 0.869400 Epoch 22, CIFAR-10 Batch 45: Loss: 0.2236 Validation Accuracy: 0.866600 Epoch 22, CIFAR-10 Batch 46: Loss: 0.2677 Validation Accuracy: 0.865800 Epoch 22, CIFAR-10 Batch 47: Loss: 0.2324 Validation Accuracy: 0.868000 Epoch 22, CIFAR-10 Batch 48: Loss: 0.2888 Validation Accuracy: 0.873400 Epoch 22, CIFAR-10 Batch 49: Loss: 0.3137 Validation Accuracy: 0.867000 Epoch 22, CIFAR-10 Batch 50: Loss: 0.2900 Validation Accuracy: 0.867800 Epoch 23, CIFAR-10 Batch 1: Loss: 0.2014 Validation Accuracy: 0.856800 Epoch 23, CIFAR-10 Batch 2: Loss: 0.2440 Validation Accuracy: 0.871000 Epoch 23, CIFAR-10 Batch 3: Loss: 0.2060 Validation Accuracy: 0.861000 Epoch 23, CIFAR-10 Batch 4: Loss: 0.2178 Validation Accuracy: 0.866200 Epoch 23, CIFAR-10 Batch 5: Loss: 0.2621 Validation Accuracy: 0.862600 Epoch 23, CIFAR-10 Batch 6: Loss: 0.3091 Validation Accuracy: 0.865800 Epoch 23, CIFAR-10 Batch 7: Loss: 0.1635 Validation Accuracy: 0.840200 Epoch 23, CIFAR-10 Batch 8: Loss: 0.3478 Validation Accuracy: 0.881800 Epoch 23, CIFAR-10 Batch 9: Loss: 0.3059 Validation Accuracy: 0.865200 Epoch 23, CIFAR-10 Batch 10: Loss: 0.1503 Validation Accuracy: 0.862600 Epoch 23, CIFAR-10 Batch 11: Loss: 0.3416 Validation Accuracy: 0.862200 Epoch 23, CIFAR-10 Batch 12: Loss: 0.2609 Validation Accuracy: 0.859800 Epoch 23, CIFAR-10 Batch 13: Loss: 0.2885 Validation Accuracy: 0.858400 Epoch 23, CIFAR-10 Batch 14: Loss: 0.2669 Validation Accuracy: 0.851800 Epoch 23, CIFAR-10 Batch 15: Loss: 0.2227 Validation Accuracy: 0.870800 Epoch 23, CIFAR-10 Batch 16: Loss: 0.1844 Validation Accuracy: 0.862200 Epoch 23, CIFAR-10 Batch 17: Loss: 0.4130 Validation Accuracy: 0.867000 Epoch 23, CIFAR-10 Batch 18: Loss: 0.2451 Validation Accuracy: 0.860400 Epoch 23, CIFAR-10 Batch 19: Loss: 0.1677 Validation Accuracy: 0.872000 Epoch 23, CIFAR-10 Batch 20: Loss: 0.3579 Validation Accuracy: 0.872000 Epoch 23, CIFAR-10 Batch 21: Loss: 0.3064 Validation Accuracy: 0.863600 Epoch 23, CIFAR-10 Batch 22: Loss: 0.3023 Validation Accuracy: 0.870800 Epoch 23, CIFAR-10 Batch 23: Loss: 0.2868 Validation Accuracy: 0.848600 Epoch 23, CIFAR-10 Batch 24: Loss: 0.2966 Validation Accuracy: 0.876200 Epoch 23, CIFAR-10 Batch 25: Loss: 0.2826 Validation Accuracy: 0.867000 Epoch 23, CIFAR-10 Batch 26: Loss: 0.2249 Validation Accuracy: 0.880600 Epoch 23, CIFAR-10 Batch 27: Loss: 0.1639 Validation Accuracy: 0.865000 Epoch 23, CIFAR-10 Batch 28: Loss: 0.3864 Validation Accuracy: 0.868000 Epoch 23, CIFAR-10 Batch 29: Loss: 0.1841 Validation Accuracy: 0.866200 Epoch 23, CIFAR-10 Batch 30: Loss: 0.1543 Validation Accuracy: 0.863800 Epoch 23, CIFAR-10 Batch 31: Loss: 0.2557 Validation Accuracy: 0.853000 Epoch 23, CIFAR-10 Batch 32: Loss: 0.2178 Validation Accuracy: 0.874200 Epoch 23, CIFAR-10 Batch 33: Loss: 0.4008 Validation Accuracy: 0.871800 Epoch 23, CIFAR-10 Batch 34: Loss: 0.3761 Validation Accuracy: 0.863800 Epoch 23, CIFAR-10 Batch 35: Loss: 0.3479 Validation Accuracy: 0.871600 Epoch 23, CIFAR-10 Batch 36: Loss: 0.3328 Validation Accuracy: 0.860200 Epoch 23, CIFAR-10 Batch 37: Loss: 0.1966 Validation Accuracy: 0.863800 Epoch 23, CIFAR-10 Batch 38: Loss: 0.1833 Validation Accuracy: 0.865600 Epoch 23, CIFAR-10 Batch 39: Loss: 0.1550 Validation Accuracy: 0.869600 Epoch 23, CIFAR-10 Batch 40: Loss: 0.2855 Validation Accuracy: 0.857000 Epoch 23, CIFAR-10 Batch 41: Loss: 0.2567 Validation Accuracy: 0.866800 Epoch 23, CIFAR-10 Batch 42: Loss: 0.2458 Validation Accuracy: 0.872800 Epoch 23, CIFAR-10 Batch 43: Loss: 0.3855 Validation Accuracy: 0.857400 Epoch 23, CIFAR-10 Batch 44: Loss: 0.2758 Validation Accuracy: 0.864200 Epoch 23, CIFAR-10 Batch 45: Loss: 0.2765 Validation Accuracy: 0.864800 Epoch 23, CIFAR-10 Batch 46: Loss: 0.3206 Validation Accuracy: 0.873600 Epoch 23, CIFAR-10 Batch 47: Loss: 0.2131 Validation Accuracy: 0.853200 Epoch 23, CIFAR-10 Batch 48: Loss: 0.2239 Validation Accuracy: 0.877600 Epoch 23, CIFAR-10 Batch 49: Loss: 0.3538 Validation Accuracy: 0.864800 Epoch 23, CIFAR-10 Batch 50: Loss: 0.2686 Validation Accuracy: 0.869400 Epoch 24, CIFAR-10 Batch 1: Loss: 0.1822 Validation Accuracy: 0.875600 Epoch 24, CIFAR-10 Batch 2: Loss: 0.2317 Validation Accuracy: 0.845400 Epoch 24, CIFAR-10 Batch 3: Loss: 0.1541 Validation Accuracy: 0.870000 Epoch 24, CIFAR-10 Batch 4: Loss: 0.1868 Validation Accuracy: 0.861600 Epoch 24, CIFAR-10 Batch 5: Loss: 0.2749 Validation Accuracy: 0.870200 Epoch 24, CIFAR-10 Batch 6: Loss: 0.3807 Validation Accuracy: 0.874000 Epoch 24, CIFAR-10 Batch 7: Loss: 0.2226 Validation Accuracy: 0.859600 Epoch 24, CIFAR-10 Batch 8: Loss: 0.3115 Validation Accuracy: 0.875000 Epoch 24, CIFAR-10 Batch 9: Loss: 0.3125 Validation Accuracy: 0.861600 Epoch 24, CIFAR-10 Batch 10: Loss: 0.1540 Validation Accuracy: 0.875600 Epoch 24, CIFAR-10 Batch 11: Loss: 0.2928 Validation Accuracy: 0.869400 Epoch 24, CIFAR-10 Batch 12: Loss: 0.3135 Validation Accuracy: 0.853600 Epoch 24, CIFAR-10 Batch 13: Loss: 0.2751 Validation Accuracy: 0.855200 Epoch 24, CIFAR-10 Batch 14: Loss: 0.2599 Validation Accuracy: 0.869000 Epoch 24, CIFAR-10 Batch 15: Loss: 0.1869 Validation Accuracy: 0.870200 Epoch 24, CIFAR-10 Batch 16: Loss: 0.1983 Validation Accuracy: 0.831800 Epoch 24, CIFAR-10 Batch 17: Loss: 0.4209 Validation Accuracy: 0.868800 Epoch 24, CIFAR-10 Batch 18: Loss: 0.2185 Validation Accuracy: 0.860200 Epoch 24, CIFAR-10 Batch 19: Loss: 0.1770 Validation Accuracy: 0.870200 Epoch 24, CIFAR-10 Batch 20: Loss: 0.2752 Validation Accuracy: 0.866000 Epoch 24, CIFAR-10 Batch 21: Loss: 0.1838 Validation Accuracy: 0.865000 Epoch 24, CIFAR-10 Batch 22: Loss: 0.2252 Validation Accuracy: 0.862200 Epoch 24, CIFAR-10 Batch 23: Loss: 0.3196 Validation Accuracy: 0.857000 Epoch 24, CIFAR-10 Batch 24: Loss: 0.3164 Validation Accuracy: 0.844400 Epoch 24, CIFAR-10 Batch 25: Loss: 0.2620 Validation Accuracy: 0.857000 Epoch 24, CIFAR-10 Batch 26: Loss: 0.2244 Validation Accuracy: 0.869400 Epoch 24, CIFAR-10 Batch 27: Loss: 0.1777 Validation Accuracy: 0.847000 Epoch 24, CIFAR-10 Batch 28: Loss: 0.4309 Validation Accuracy: 0.866600 Epoch 24, CIFAR-10 Batch 29: Loss: 0.2235 Validation Accuracy: 0.866600 Epoch 24, CIFAR-10 Batch 30: Loss: 0.1448 Validation Accuracy: 0.873600 Epoch 24, CIFAR-10 Batch 31: Loss: 0.1921 Validation Accuracy: 0.853800 Epoch 24, CIFAR-10 Batch 32: Loss: 0.2173 Validation Accuracy: 0.868800 Epoch 24, CIFAR-10 Batch 33: Loss: 0.3767 Validation Accuracy: 0.863400 Epoch 24, CIFAR-10 Batch 34: Loss: 0.3666 Validation Accuracy: 0.861000 Epoch 24, CIFAR-10 Batch 35: Loss: 0.3903 Validation Accuracy: 0.866200 Epoch 24, CIFAR-10 Batch 36: Loss: 0.2915 Validation Accuracy: 0.867600 Epoch 24, CIFAR-10 Batch 37: Loss: 0.2211 Validation Accuracy: 0.864800 Epoch 24, CIFAR-10 Batch 38: Loss: 0.2146 Validation Accuracy: 0.858600 Epoch 24, CIFAR-10 Batch 39: Loss: 0.1489 Validation Accuracy: 0.873000 Epoch 24, CIFAR-10 Batch 40: Loss: 0.2312 Validation Accuracy: 0.868800 Epoch 24, CIFAR-10 Batch 41: Loss: 0.2340 Validation Accuracy: 0.865800 Epoch 24, CIFAR-10 Batch 42: Loss: 0.2373 Validation Accuracy: 0.853800 Epoch 24, CIFAR-10 Batch 43: Loss: 0.3406 Validation Accuracy: 0.872600 Epoch 24, CIFAR-10 Batch 44: Loss: 0.2625 Validation Accuracy: 0.859400 Epoch 24, CIFAR-10 Batch 45: Loss: 0.1880 Validation Accuracy: 0.874600 Epoch 24, CIFAR-10 Batch 46: Loss: 0.3331 Validation Accuracy: 0.863800 Epoch 24, CIFAR-10 Batch 47: Loss: 0.1709 Validation Accuracy: 0.865800 Epoch 24, CIFAR-10 Batch 48: Loss: 0.2607 Validation Accuracy: 0.871800 Epoch 24, CIFAR-10 Batch 49: Loss: 0.3169 Validation Accuracy: 0.870800 Epoch 24, CIFAR-10 Batch 50: Loss: 0.1992 Validation Accuracy: 0.863600 Epoch 25, CIFAR-10 Batch 1: Loss: 0.1721 Validation Accuracy: 0.876200 Epoch 25, CIFAR-10 Batch 2: Loss: 0.1913 Validation Accuracy: 0.863200 Epoch 25, CIFAR-10 Batch 3: Loss: 0.1990 Validation Accuracy: 0.862400 Epoch 25, CIFAR-10 Batch 4: Loss: 0.2007 Validation Accuracy: 0.862800 Epoch 25, CIFAR-10 Batch 5: Loss: 0.2607 Validation Accuracy: 0.878800 Epoch 25, CIFAR-10 Batch 6: Loss: 0.3822 Validation Accuracy: 0.853200 Epoch 25, CIFAR-10 Batch 7: Loss: 0.1570 Validation Accuracy: 0.848600 Epoch 25, CIFAR-10 Batch 8: Loss: 0.3452 Validation Accuracy: 0.869000 Epoch 25, CIFAR-10 Batch 9: Loss: 0.2718 Validation Accuracy: 0.879200 Epoch 25, CIFAR-10 Batch 10: Loss: 0.1510 Validation Accuracy: 0.864800 Epoch 25, CIFAR-10 Batch 11: Loss: 0.3189 Validation Accuracy: 0.870400 Epoch 25, CIFAR-10 Batch 12: Loss: 0.2476 Validation Accuracy: 0.868400 Epoch 25, CIFAR-10 Batch 13: Loss: 0.3093 Validation Accuracy: 0.863400 Epoch 25, CIFAR-10 Batch 14: Loss: 0.2292 Validation Accuracy: 0.877400 Epoch 25, CIFAR-10 Batch 15: Loss: 0.1874 Validation Accuracy: 0.864400 Epoch 25, CIFAR-10 Batch 16: Loss: 0.1859 Validation Accuracy: 0.856200 Epoch 25, CIFAR-10 Batch 17: Loss: 0.3699 Validation Accuracy: 0.856800 Epoch 25, CIFAR-10 Batch 18: Loss: 0.1752 Validation Accuracy: 0.858400 Epoch 25, CIFAR-10 Batch 19: Loss: 0.2000 Validation Accuracy: 0.864600 Epoch 25, CIFAR-10 Batch 20: Loss: 0.3513 Validation Accuracy: 0.877000 Epoch 25, CIFAR-10 Batch 21: Loss: 0.2233 Validation Accuracy: 0.875800 Epoch 25, CIFAR-10 Batch 22: Loss: 0.2049 Validation Accuracy: 0.875400 Epoch 25, CIFAR-10 Batch 23: Loss: 0.2859 Validation Accuracy: 0.870000 Epoch 25, CIFAR-10 Batch 24: Loss: 0.2352 Validation Accuracy: 0.862800 Epoch 25, CIFAR-10 Batch 25: Loss: 0.2309 Validation Accuracy: 0.858000 Epoch 25, CIFAR-10 Batch 26: Loss: 0.2076 Validation Accuracy: 0.869800 Epoch 25, CIFAR-10 Batch 27: Loss: 0.1781 Validation Accuracy: 0.868400 Epoch 25, CIFAR-10 Batch 28: Loss: 0.3703 Validation Accuracy: 0.862400 Epoch 25, CIFAR-10 Batch 29: Loss: 0.2373 Validation Accuracy: 0.877800 Epoch 25, CIFAR-10 Batch 30: Loss: 0.1500 Validation Accuracy: 0.863000 Epoch 25, CIFAR-10 Batch 31: Loss: 0.2098 Validation Accuracy: 0.868800 Epoch 25, CIFAR-10 Batch 32: Loss: 0.1966 Validation Accuracy: 0.866400 Epoch 25, CIFAR-10 Batch 33: Loss: 0.4105 Validation Accuracy: 0.844800 Epoch 25, CIFAR-10 Batch 34: Loss: 0.3491 Validation Accuracy: 0.849000 Epoch 25, CIFAR-10 Batch 35: Loss: 0.4086 Validation Accuracy: 0.875000 Epoch 25, CIFAR-10 Batch 36: Loss: 0.3278 Validation Accuracy: 0.854000 Epoch 25, CIFAR-10 Batch 37: Loss: 0.2237 Validation Accuracy: 0.857200 Epoch 25, CIFAR-10 Batch 38: Loss: 0.1610 Validation Accuracy: 0.874600 Epoch 25, CIFAR-10 Batch 39: Loss: 0.1598 Validation Accuracy: 0.866200 Epoch 25, CIFAR-10 Batch 40: Loss: 0.2445 Validation Accuracy: 0.859400 Epoch 25, CIFAR-10 Batch 41: Loss: 0.2888 Validation Accuracy: 0.862600 Epoch 25, CIFAR-10 Batch 42: Loss: 0.2275 Validation Accuracy: 0.866800 Epoch 25, CIFAR-10 Batch 43: Loss: 0.3471 Validation Accuracy: 0.872200 Epoch 25, CIFAR-10 Batch 44: Loss: 0.2803 Validation Accuracy: 0.865600 Epoch 25, CIFAR-10 Batch 45: Loss: 0.2431 Validation Accuracy: 0.862400 Epoch 25, CIFAR-10 Batch 46: Loss: 0.3248 Validation Accuracy: 0.870600 Epoch 25, CIFAR-10 Batch 47: Loss: 0.2287 Validation Accuracy: 0.863000 Epoch 25, CIFAR-10 Batch 48: Loss: 0.2283 Validation Accuracy: 0.873200 Epoch 25, CIFAR-10 Batch 49: Loss: 0.3234 Validation Accuracy: 0.870200 Epoch 25, CIFAR-10 Batch 50: Loss: 0.2278 Validation Accuracy: 0.865200 Epoch 26, CIFAR-10 Batch 1: Loss: 0.2489 Validation Accuracy: 0.862600 Epoch 26, CIFAR-10 Batch 2: Loss: 0.2194 Validation Accuracy: 0.850200 Epoch 26, CIFAR-10 Batch 3: Loss: 0.1900 Validation Accuracy: 0.877400 Epoch 26, CIFAR-10 Batch 4: Loss: 0.2006 Validation Accuracy: 0.867000 Epoch 26, CIFAR-10 Batch 5: Loss: 0.2445 Validation Accuracy: 0.865400 Epoch 26, CIFAR-10 Batch 6: Loss: 0.4398 Validation Accuracy: 0.873000 Epoch 26, CIFAR-10 Batch 7: Loss: 0.2067 Validation Accuracy: 0.854600 Epoch 26, CIFAR-10 Batch 8: Loss: 0.3514 Validation Accuracy: 0.873800 Epoch 26, CIFAR-10 Batch 9: Loss: 0.2620 Validation Accuracy: 0.860400 Epoch 26, CIFAR-10 Batch 10: Loss: 0.1936 Validation Accuracy: 0.875200 Epoch 26, CIFAR-10 Batch 11: Loss: 0.2669 Validation Accuracy: 0.845200 Epoch 26, CIFAR-10 Batch 12: Loss: 0.2871 Validation Accuracy: 0.855800 Epoch 26, CIFAR-10 Batch 13: Loss: 0.2716 Validation Accuracy: 0.873800 Epoch 26, CIFAR-10 Batch 14: Loss: 0.3041 Validation Accuracy: 0.870400 Epoch 26, CIFAR-10 Batch 15: Loss: 0.2516 Validation Accuracy: 0.852000 Epoch 26, CIFAR-10 Batch 16: Loss: 0.2396 Validation Accuracy: 0.868600 Epoch 26, CIFAR-10 Batch 17: Loss: 0.3671 Validation Accuracy: 0.869600 Epoch 26, CIFAR-10 Batch 18: Loss: 0.2032 Validation Accuracy: 0.868400 Epoch 26, CIFAR-10 Batch 19: Loss: 0.1999 Validation Accuracy: 0.873400 Epoch 26, CIFAR-10 Batch 20: Loss: 0.3249 Validation Accuracy: 0.866800 Epoch 26, CIFAR-10 Batch 21: Loss: 0.2124 Validation Accuracy: 0.873600 Epoch 26, CIFAR-10 Batch 22: Loss: 0.2279 Validation Accuracy: 0.851200 Epoch 26, CIFAR-10 Batch 23: Loss: 0.2927 Validation Accuracy: 0.852800 Epoch 26, CIFAR-10 Batch 24: Loss: 0.2505 Validation Accuracy: 0.879800 Epoch 26, CIFAR-10 Batch 25: Loss: 0.2620 Validation Accuracy: 0.856200 Epoch 26, CIFAR-10 Batch 26: Loss: 0.2329 Validation Accuracy: 0.867800 Epoch 26, CIFAR-10 Batch 27: Loss: 0.1702 Validation Accuracy: 0.866200 Epoch 26, CIFAR-10 Batch 28: Loss: 0.3569 Validation Accuracy: 0.870600 Epoch 26, CIFAR-10 Batch 29: Loss: 0.2662 Validation Accuracy: 0.861200 Epoch 26, CIFAR-10 Batch 30: Loss: 0.1680 Validation Accuracy: 0.863000 Epoch 26, CIFAR-10 Batch 31: Loss: 0.2182 Validation Accuracy: 0.857200 Epoch 26, CIFAR-10 Batch 32: Loss: 0.2134 Validation Accuracy: 0.872400 Epoch 26, CIFAR-10 Batch 33: Loss: 0.4222 Validation Accuracy: 0.863600 Epoch 26, CIFAR-10 Batch 34: Loss: 0.3878 Validation Accuracy: 0.866200 Epoch 26, CIFAR-10 Batch 35: Loss: 0.3056 Validation Accuracy: 0.865800 Epoch 26, CIFAR-10 Batch 36: Loss: 0.3251 Validation Accuracy: 0.868400 Epoch 26, CIFAR-10 Batch 37: Loss: 0.2292 Validation Accuracy: 0.876600 Epoch 26, CIFAR-10 Batch 38: Loss: 0.1650 Validation Accuracy: 0.873800 Epoch 26, CIFAR-10 Batch 39: Loss: 0.1616 Validation Accuracy: 0.868200 Epoch 26, CIFAR-10 Batch 40: Loss: 0.2446 Validation Accuracy: 0.865400 Epoch 26, CIFAR-10 Batch 41: Loss: 0.2461 Validation Accuracy: 0.874200 Epoch 26, CIFAR-10 Batch 42: Loss: 0.2324 Validation Accuracy: 0.867600 Epoch 26, CIFAR-10 Batch 43: Loss: 0.3628 Validation Accuracy: 0.865200 Epoch 26, CIFAR-10 Batch 44: Loss: 0.2925 Validation Accuracy: 0.859800 Epoch 26, CIFAR-10 Batch 45: Loss: 0.2280 Validation Accuracy: 0.866200 Epoch 26, CIFAR-10 Batch 46: Loss: 0.3135 Validation Accuracy: 0.871800 Epoch 26, CIFAR-10 Batch 47: Loss: 0.2361 Validation Accuracy: 0.869200 Epoch 26, CIFAR-10 Batch 48: Loss: 0.2433 Validation Accuracy: 0.869200 Epoch 26, CIFAR-10 Batch 49: Loss: 0.2623 Validation Accuracy: 0.864400 Epoch 26, CIFAR-10 Batch 50: Loss: 0.2725 Validation Accuracy: 0.876000 Epoch 27, CIFAR-10 Batch 1: Loss: 0.2161 Validation Accuracy: 0.856400 Epoch 27, CIFAR-10 Batch 2: Loss: 0.2946 Validation Accuracy: 0.874400 Epoch 27, CIFAR-10 Batch 3: Loss: 0.1749 Validation Accuracy: 0.869200 Epoch 27, CIFAR-10 Batch 4: Loss: 0.1756 Validation Accuracy: 0.872200 Epoch 27, CIFAR-10 Batch 5: Loss: 0.2044 Validation Accuracy: 0.865200 Epoch 27, CIFAR-10 Batch 6: Loss: 0.4036 Validation Accuracy: 0.867800 Epoch 27, CIFAR-10 Batch 7: Loss: 0.1676 Validation Accuracy: 0.865800 Epoch 27, CIFAR-10 Batch 8: Loss: 0.3454 Validation Accuracy: 0.870200 Epoch 27, CIFAR-10 Batch 9: Loss: 0.2378 Validation Accuracy: 0.873600 Epoch 27, CIFAR-10 Batch 10: Loss: 0.1706 Validation Accuracy: 0.876200 Epoch 27, CIFAR-10 Batch 11: Loss: 0.2712 Validation Accuracy: 0.870000 Epoch 27, CIFAR-10 Batch 12: Loss: 0.3071 Validation Accuracy: 0.869800 Epoch 27, CIFAR-10 Batch 13: Loss: 0.2692 Validation Accuracy: 0.876600 Epoch 27, CIFAR-10 Batch 14: Loss: 0.3143 Validation Accuracy: 0.865800 Epoch 27, CIFAR-10 Batch 15: Loss: 0.1761 Validation Accuracy: 0.838200 Epoch 27, CIFAR-10 Batch 16: Loss: 0.2075 Validation Accuracy: 0.860400 Epoch 27, CIFAR-10 Batch 17: Loss: 0.3166 Validation Accuracy: 0.864400 Epoch 27, CIFAR-10 Batch 18: Loss: 0.1819 Validation Accuracy: 0.870200 Epoch 27, CIFAR-10 Batch 19: Loss: 0.2013 Validation Accuracy: 0.868200 Epoch 27, CIFAR-10 Batch 20: Loss: 0.3243 Validation Accuracy: 0.879800 Epoch 27, CIFAR-10 Batch 21: Loss: 0.1768 Validation Accuracy: 0.857000 Epoch 27, CIFAR-10 Batch 22: Loss: 0.2800 Validation Accuracy: 0.869800 Epoch 27, CIFAR-10 Batch 23: Loss: 0.2986 Validation Accuracy: 0.860800 Epoch 27, CIFAR-10 Batch 24: Loss: 0.2470 Validation Accuracy: 0.875200 Epoch 27, CIFAR-10 Batch 25: Loss: 0.2476 Validation Accuracy: 0.861600 Epoch 27, CIFAR-10 Batch 26: Loss: 0.2043 Validation Accuracy: 0.880400 Epoch 27, CIFAR-10 Batch 27: Loss: 0.1536 Validation Accuracy: 0.872000 Epoch 27, CIFAR-10 Batch 28: Loss: 0.3277 Validation Accuracy: 0.871000 Epoch 27, CIFAR-10 Batch 29: Loss: 0.2472 Validation Accuracy: 0.879000 Epoch 27, CIFAR-10 Batch 30: Loss: 0.1719 Validation Accuracy: 0.877200 Epoch 27, CIFAR-10 Batch 31: Loss: 0.2005 Validation Accuracy: 0.859400 Epoch 27, CIFAR-10 Batch 32: Loss: 0.1946 Validation Accuracy: 0.881000 Epoch 27, CIFAR-10 Batch 33: Loss: 0.3947 Validation Accuracy: 0.863400 Epoch 27, CIFAR-10 Batch 34: Loss: 0.4406 Validation Accuracy: 0.842400 Epoch 27, CIFAR-10 Batch 35: Loss: 0.3231 Validation Accuracy: 0.873000 Epoch 27, CIFAR-10 Batch 36: Loss: 0.2829 Validation Accuracy: 0.845600 Epoch 27, CIFAR-10 Batch 37: Loss: 0.2181 Validation Accuracy: 0.866800 Epoch 27, CIFAR-10 Batch 38: Loss: 0.1545 Validation Accuracy: 0.857000 Epoch 27, CIFAR-10 Batch 39: Loss: 0.1657 Validation Accuracy: 0.869800 Epoch 27, CIFAR-10 Batch 40: Loss: 0.2781 Validation Accuracy: 0.878800 Epoch 27, CIFAR-10 Batch 41: Loss: 0.2511 Validation Accuracy: 0.851000 Epoch 27, CIFAR-10 Batch 42: Loss: 0.2291 Validation Accuracy: 0.863600 Epoch 27, CIFAR-10 Batch 43: Loss: 0.3396 Validation Accuracy: 0.871600 Epoch 27, CIFAR-10 Batch 44: Loss: 0.2328 Validation Accuracy: 0.861800 Epoch 27, CIFAR-10 Batch 45: Loss: 0.2062 Validation Accuracy: 0.856800 Epoch 27, CIFAR-10 Batch 46: Loss: 0.2596 Validation Accuracy: 0.866200 Epoch 27, CIFAR-10 Batch 47: Loss: 0.2348 Validation Accuracy: 0.864000 Epoch 27, CIFAR-10 Batch 48: Loss: 0.2552 Validation Accuracy: 0.859600 Epoch 27, CIFAR-10 Batch 49: Loss: 0.2985 Validation Accuracy: 0.867800 Epoch 27, CIFAR-10 Batch 50: Loss: 0.2497 Validation Accuracy: 0.877800 Epoch 28, CIFAR-10 Batch 1: Loss: 0.1854 Validation Accuracy: 0.868200 Epoch 28, CIFAR-10 Batch 2: Loss: 0.2440 Validation Accuracy: 0.861000 Epoch 28, CIFAR-10 Batch 3: Loss: 0.1712 Validation Accuracy: 0.864800 Epoch 28, CIFAR-10 Batch 4: Loss: 0.1593 Validation Accuracy: 0.865200 Epoch 28, CIFAR-10 Batch 5: Loss: 0.2032 Validation Accuracy: 0.859800 Epoch 28, CIFAR-10 Batch 6: Loss: 0.3990 Validation Accuracy: 0.874000 Epoch 28, CIFAR-10 Batch 7: Loss: 0.1770 Validation Accuracy: 0.852600 Epoch 28, CIFAR-10 Batch 8: Loss: 0.3332 Validation Accuracy: 0.870400 Epoch 28, CIFAR-10 Batch 9: Loss: 0.2392 Validation Accuracy: 0.865600 Epoch 28, CIFAR-10 Batch 10: Loss: 0.1549 Validation Accuracy: 0.872200 Epoch 28, CIFAR-10 Batch 11: Loss: 0.2396 Validation Accuracy: 0.868000 Epoch 28, CIFAR-10 Batch 12: Loss: 0.3307 Validation Accuracy: 0.863800 Epoch 28, CIFAR-10 Batch 13: Loss: 0.2341 Validation Accuracy: 0.874000 Epoch 28, CIFAR-10 Batch 14: Loss: 0.2852 Validation Accuracy: 0.818400 Epoch 28, CIFAR-10 Batch 15: Loss: 0.1834 Validation Accuracy: 0.872000 Epoch 28, CIFAR-10 Batch 16: Loss: 0.2005 Validation Accuracy: 0.864800 Epoch 28, CIFAR-10 Batch 17: Loss: 0.3053 Validation Accuracy: 0.862800 Epoch 28, CIFAR-10 Batch 18: Loss: 0.2039 Validation Accuracy: 0.862000 Epoch 28, CIFAR-10 Batch 19: Loss: 0.1747 Validation Accuracy: 0.867400 Epoch 28, CIFAR-10 Batch 20: Loss: 0.3183 Validation Accuracy: 0.879000 Epoch 28, CIFAR-10 Batch 21: Loss: 0.2640 Validation Accuracy: 0.868200 Epoch 28, CIFAR-10 Batch 22: Loss: 0.2141 Validation Accuracy: 0.862800 Epoch 28, CIFAR-10 Batch 23: Loss: 0.2652 Validation Accuracy: 0.873400 Epoch 28, CIFAR-10 Batch 24: Loss: 0.2285 Validation Accuracy: 0.874600 Epoch 28, CIFAR-10 Batch 25: Loss: 0.2909 Validation Accuracy: 0.875400 Epoch 28, CIFAR-10 Batch 26: Loss: 0.2069 Validation Accuracy: 0.869800 Epoch 28, CIFAR-10 Batch 27: Loss: 0.2055 Validation Accuracy: 0.864000 Epoch 28, CIFAR-10 Batch 28: Loss: 0.2780 Validation Accuracy: 0.866800 Epoch 28, CIFAR-10 Batch 29: Loss: 0.1905 Validation Accuracy: 0.869800 Epoch 28, CIFAR-10 Batch 30: Loss: 0.1775 Validation Accuracy: 0.871200 Epoch 28, CIFAR-10 Batch 31: Loss: 0.1987 Validation Accuracy: 0.867000 Epoch 28, CIFAR-10 Batch 32: Loss: 0.1840 Validation Accuracy: 0.862800 Epoch 28, CIFAR-10 Batch 33: Loss: 0.3378 Validation Accuracy: 0.859400 Epoch 28, CIFAR-10 Batch 34: Loss: 0.3926 Validation Accuracy: 0.863400 Epoch 28, CIFAR-10 Batch 35: Loss: 0.2756 Validation Accuracy: 0.868800 Epoch 28, CIFAR-10 Batch 36: Loss: 0.3185 Validation Accuracy: 0.856000 Epoch 28, CIFAR-10 Batch 37: Loss: 0.1653 Validation Accuracy: 0.878000 Epoch 28, CIFAR-10 Batch 38: Loss: 0.1633 Validation Accuracy: 0.866000 Epoch 28, CIFAR-10 Batch 39: Loss: 0.2027 Validation Accuracy: 0.862600 Epoch 28, CIFAR-10 Batch 40: Loss: 0.2217 Validation Accuracy: 0.865400 Epoch 28, CIFAR-10 Batch 41: Loss: 0.2056 Validation Accuracy: 0.858800 Epoch 28, CIFAR-10 Batch 42: Loss: 0.2371 Validation Accuracy: 0.854200 Epoch 28, CIFAR-10 Batch 43: Loss: 0.3120 Validation Accuracy: 0.871000 Epoch 28, CIFAR-10 Batch 44: Loss: 0.2619 Validation Accuracy: 0.860400 Epoch 28, CIFAR-10 Batch 45: Loss: 0.1762 Validation Accuracy: 0.867400 Epoch 28, CIFAR-10 Batch 46: Loss: 0.3162 Validation Accuracy: 0.856000 Epoch 28, CIFAR-10 Batch 47: Loss: 0.2271 Validation Accuracy: 0.869200 Epoch 28, CIFAR-10 Batch 48: Loss: 0.3159 Validation Accuracy: 0.862000 Epoch 28, CIFAR-10 Batch 49: Loss: 0.2801 Validation Accuracy: 0.853200 Epoch 28, CIFAR-10 Batch 50: Loss: 0.1942 Validation Accuracy: 0.875600 Epoch 29, CIFAR-10 Batch 1: Loss: 0.1794 Validation Accuracy: 0.846000 Epoch 29, CIFAR-10 Batch 2: Loss: 0.1747 Validation Accuracy: 0.878200 Epoch 29, CIFAR-10 Batch 3: Loss: 0.1870 Validation Accuracy: 0.880200 Epoch 29, CIFAR-10 Batch 4: Loss: 0.1968 Validation Accuracy: 0.875200 Epoch 29, CIFAR-10 Batch 5: Loss: 0.2003 Validation Accuracy: 0.869200 Epoch 29, CIFAR-10 Batch 6: Loss: 0.4272 Validation Accuracy: 0.873600 Epoch 29, CIFAR-10 Batch 7: Loss: 0.2283 Validation Accuracy: 0.867600 Epoch 29, CIFAR-10 Batch 8: Loss: 0.3279 Validation Accuracy: 0.881200 Epoch 29, CIFAR-10 Batch 9: Loss: 0.2476 Validation Accuracy: 0.876400 Epoch 29, CIFAR-10 Batch 10: Loss: 0.1673 Validation Accuracy: 0.864600 Epoch 29, CIFAR-10 Batch 11: Loss: 0.2660 Validation Accuracy: 0.865600 Epoch 29, CIFAR-10 Batch 12: Loss: 0.2609 Validation Accuracy: 0.855000 Epoch 29, CIFAR-10 Batch 13: Loss: 0.2742 Validation Accuracy: 0.860800 Epoch 29, CIFAR-10 Batch 14: Loss: 0.2178 Validation Accuracy: 0.872000 Epoch 29, CIFAR-10 Batch 15: Loss: 0.1969 Validation Accuracy: 0.878400 Epoch 29, CIFAR-10 Batch 16: Loss: 0.1872 Validation Accuracy: 0.857800 Epoch 29, CIFAR-10 Batch 17: Loss: 0.2882 Validation Accuracy: 0.854800 Epoch 29, CIFAR-10 Batch 18: Loss: 0.2127 Validation Accuracy: 0.864200 Epoch 29, CIFAR-10 Batch 19: Loss: 0.2275 Validation Accuracy: 0.847400 Epoch 29, CIFAR-10 Batch 20: Loss: 0.3914 Validation Accuracy: 0.870600 Epoch 29, CIFAR-10 Batch 21: Loss: 0.1947 Validation Accuracy: 0.879600 Epoch 29, CIFAR-10 Batch 22: Loss: 0.2432 Validation Accuracy: 0.874600 Epoch 29, CIFAR-10 Batch 23: Loss: 0.3108 Validation Accuracy: 0.867000 Epoch 29, CIFAR-10 Batch 24: Loss: 0.2489 Validation Accuracy: 0.883200 Epoch 29, CIFAR-10 Batch 25: Loss: 0.2617 Validation Accuracy: 0.868800 Epoch 29, CIFAR-10 Batch 26: Loss: 0.2017 Validation Accuracy: 0.877600 Epoch 29, CIFAR-10 Batch 27: Loss: 0.1619 Validation Accuracy: 0.859400 Epoch 29, CIFAR-10 Batch 28: Loss: 0.3152 Validation Accuracy: 0.869400 Epoch 29, CIFAR-10 Batch 29: Loss: 0.1982 Validation Accuracy: 0.866400 Epoch 29, CIFAR-10 Batch 30: Loss: 0.1795 Validation Accuracy: 0.881200 Epoch 29, CIFAR-10 Batch 31: Loss: 0.2180 Validation Accuracy: 0.870200 Epoch 29, CIFAR-10 Batch 32: Loss: 0.1655 Validation Accuracy: 0.852800 Epoch 29, CIFAR-10 Batch 33: Loss: 0.3296 Validation Accuracy: 0.860600 Epoch 29, CIFAR-10 Batch 34: Loss: 0.3876 Validation Accuracy: 0.863400 Epoch 29, CIFAR-10 Batch 35: Loss: 0.2808 Validation Accuracy: 0.879600 Epoch 29, CIFAR-10 Batch 36: Loss: 0.2788 Validation Accuracy: 0.843000 Epoch 29, CIFAR-10 Batch 37: Loss: 0.2127 Validation Accuracy: 0.868200 Epoch 29, CIFAR-10 Batch 38: Loss: 0.1738 Validation Accuracy: 0.869200 Epoch 29, CIFAR-10 Batch 39: Loss: 0.1763 Validation Accuracy: 0.870600 Epoch 29, CIFAR-10 Batch 40: Loss: 0.2554 Validation Accuracy: 0.857000 Epoch 29, CIFAR-10 Batch 41: Loss: 0.2178 Validation Accuracy: 0.873200 Epoch 29, CIFAR-10 Batch 42: Loss: 0.2586 Validation Accuracy: 0.864200 Epoch 29, CIFAR-10 Batch 43: Loss: 0.3077 Validation Accuracy: 0.865600 Epoch 29, CIFAR-10 Batch 44: Loss: 0.2836 Validation Accuracy: 0.857800 Epoch 29, CIFAR-10 Batch 45: Loss: 0.2269 Validation Accuracy: 0.865400 Epoch 29, CIFAR-10 Batch 46: Loss: 0.3377 Validation Accuracy: 0.874600 Epoch 29, CIFAR-10 Batch 47: Loss: 0.1700 Validation Accuracy: 0.873800 Epoch 29, CIFAR-10 Batch 48: Loss: 0.2467 Validation Accuracy: 0.876000 Epoch 29, CIFAR-10 Batch 49: Loss: 0.2879 Validation Accuracy: 0.862000 Epoch 29, CIFAR-10 Batch 50: Loss: 0.1951 Validation Accuracy: 0.881200 Epoch 30, CIFAR-10 Batch 1: Loss: 0.1804 Validation Accuracy: 0.875400 Epoch 30, CIFAR-10 Batch 2: Loss: 0.1908 Validation Accuracy: 0.879600 Epoch 30, CIFAR-10 Batch 3: Loss: 0.1755 Validation Accuracy: 0.881600 Epoch 30, CIFAR-10 Batch 4: Loss: 0.1719 Validation Accuracy: 0.864400 Epoch 30, CIFAR-10 Batch 5: Loss: 0.2248 Validation Accuracy: 0.878200 Epoch 30, CIFAR-10 Batch 6: Loss: 0.3569 Validation Accuracy: 0.864800 Epoch 30, CIFAR-10 Batch 7: Loss: 0.1738 Validation Accuracy: 0.864800 Epoch 30, CIFAR-10 Batch 8: Loss: 0.2629 Validation Accuracy: 0.871200 Epoch 30, CIFAR-10 Batch 9: Loss: 0.1964 Validation Accuracy: 0.866000 Epoch 30, CIFAR-10 Batch 10: Loss: 0.1432 Validation Accuracy: 0.861400 Epoch 30, CIFAR-10 Batch 11: Loss: 0.2197 Validation Accuracy: 0.875200 Epoch 30, CIFAR-10 Batch 12: Loss: 0.2319 Validation Accuracy: 0.854400 Epoch 30, CIFAR-10 Batch 13: Loss: 0.2449 Validation Accuracy: 0.871600 Epoch 30, CIFAR-10 Batch 14: Loss: 0.2116 Validation Accuracy: 0.850000 Epoch 30, CIFAR-10 Batch 15: Loss: 0.2129 Validation Accuracy: 0.868200 Epoch 30, CIFAR-10 Batch 16: Loss: 0.1968 Validation Accuracy: 0.858800 Epoch 30, CIFAR-10 Batch 17: Loss: 0.2652 Validation Accuracy: 0.873400 Epoch 30, CIFAR-10 Batch 18: Loss: 0.1697 Validation Accuracy: 0.868600 Epoch 30, CIFAR-10 Batch 19: Loss: 0.1683 Validation Accuracy: 0.869400 Epoch 30, CIFAR-10 Batch 20: Loss: 0.2920 Validation Accuracy: 0.862200 Epoch 30, CIFAR-10 Batch 21: Loss: 0.2366 Validation Accuracy: 0.865600 Epoch 30, CIFAR-10 Batch 22: Loss: 0.2232 Validation Accuracy: 0.840600 Epoch 30, CIFAR-10 Batch 23: Loss: 0.2209 Validation Accuracy: 0.863400 Epoch 30, CIFAR-10 Batch 24: Loss: 0.2008 Validation Accuracy: 0.867800 Epoch 30, CIFAR-10 Batch 25: Loss: 0.3164 Validation Accuracy: 0.839600 Epoch 30, CIFAR-10 Batch 26: Loss: 0.2351 Validation Accuracy: 0.877400 Epoch 30, CIFAR-10 Batch 27: Loss: 0.1845 Validation Accuracy: 0.859400 Epoch 30, CIFAR-10 Batch 28: Loss: 0.3013 Validation Accuracy: 0.873200 Epoch 30, CIFAR-10 Batch 29: Loss: 0.2432 Validation Accuracy: 0.879600 Epoch 30, CIFAR-10 Batch 30: Loss: 0.1505 Validation Accuracy: 0.874000 Epoch 30, CIFAR-10 Batch 31: Loss: 0.2132 Validation Accuracy: 0.864000 Epoch 30, CIFAR-10 Batch 32: Loss: 0.1702 Validation Accuracy: 0.871200 Epoch 30, CIFAR-10 Batch 33: Loss: 0.3525 Validation Accuracy: 0.876400 Epoch 30, CIFAR-10 Batch 34: Loss: 0.3221 Validation Accuracy: 0.855600 Epoch 30, CIFAR-10 Batch 35: Loss: 0.3490 Validation Accuracy: 0.875000 Epoch 30, CIFAR-10 Batch 36: Loss: 0.2727 Validation Accuracy: 0.831600 Epoch 30, CIFAR-10 Batch 37: Loss: 0.1880 Validation Accuracy: 0.881600 Epoch 30, CIFAR-10 Batch 38: Loss: 0.1653 Validation Accuracy: 0.867600 Epoch 30, CIFAR-10 Batch 39: Loss: 0.1645 Validation Accuracy: 0.867800 Epoch 30, CIFAR-10 Batch 40: Loss: 0.2294 Validation Accuracy: 0.870800 Epoch 30, CIFAR-10 Batch 41: Loss: 0.2200 Validation Accuracy: 0.852400 Epoch 30, CIFAR-10 Batch 42: Loss: 0.2486 Validation Accuracy: 0.871000 Epoch 30, CIFAR-10 Batch 43: Loss: 0.3786 Validation Accuracy: 0.861400 Epoch 30, CIFAR-10 Batch 44: Loss: 0.2692 Validation Accuracy: 0.858400 Epoch 30, CIFAR-10 Batch 45: Loss: 0.2126 Validation Accuracy: 0.863600 Epoch 30, CIFAR-10 Batch 46: Loss: 0.2404 Validation Accuracy: 0.869000 Epoch 30, CIFAR-10 Batch 47: Loss: 0.2243 Validation Accuracy: 0.865000 Epoch 30, CIFAR-10 Batch 48: Loss: 0.1974 Validation Accuracy: 0.867800 Epoch 30, CIFAR-10 Batch 49: Loss: 0.2900 Validation Accuracy: 0.856000 Epoch 30, CIFAR-10 Batch 50: Loss: 0.2339 Validation Accuracy: 0.877800 Epoch 31, CIFAR-10 Batch 1: Loss: 0.1927 Validation Accuracy: 0.875800 Epoch 31, CIFAR-10 Batch 2: Loss: 0.1814 Validation Accuracy: 0.864800 Epoch 31, CIFAR-10 Batch 3: Loss: 0.1477 Validation Accuracy: 0.877800 Epoch 31, CIFAR-10 Batch 4: Loss: 0.1716 Validation Accuracy: 0.865000 Epoch 31, CIFAR-10 Batch 5: Loss: 0.2031 Validation Accuracy: 0.868800 Epoch 31, CIFAR-10 Batch 6: Loss: 0.3377 Validation Accuracy: 0.876400 Epoch 31, CIFAR-10 Batch 7: Loss: 0.1915 Validation Accuracy: 0.854600 Epoch 31, CIFAR-10 Batch 8: Loss: 0.2434 Validation Accuracy: 0.872200 Epoch 31, CIFAR-10 Batch 9: Loss: 0.2263 Validation Accuracy: 0.865600 Epoch 31, CIFAR-10 Batch 10: Loss: 0.1494 Validation Accuracy: 0.866200 Epoch 31, CIFAR-10 Batch 11: Loss: 0.2469 Validation Accuracy: 0.855200 Epoch 31, CIFAR-10 Batch 12: Loss: 0.1858 Validation Accuracy: 0.865000 Epoch 31, CIFAR-10 Batch 13: Loss: 0.2545 Validation Accuracy: 0.859400 Epoch 31, CIFAR-10 Batch 14: Loss: 0.2409 Validation Accuracy: 0.861600 Epoch 31, CIFAR-10 Batch 15: Loss: 0.2032 Validation Accuracy: 0.855800 Epoch 31, CIFAR-10 Batch 16: Loss: 0.2230 Validation Accuracy: 0.863000 Epoch 31, CIFAR-10 Batch 17: Loss: 0.3270 Validation Accuracy: 0.872600 Epoch 31, CIFAR-10 Batch 18: Loss: 0.1985 Validation Accuracy: 0.872000 Epoch 31, CIFAR-10 Batch 19: Loss: 0.1513 Validation Accuracy: 0.873400 Epoch 31, CIFAR-10 Batch 20: Loss: 0.2925 Validation Accuracy: 0.864400 Epoch 31, CIFAR-10 Batch 21: Loss: 0.1614 Validation Accuracy: 0.866600 Epoch 31, CIFAR-10 Batch 22: Loss: 0.2246 Validation Accuracy: 0.878600 Epoch 31, CIFAR-10 Batch 23: Loss: 0.2680 Validation Accuracy: 0.871800 Epoch 31, CIFAR-10 Batch 24: Loss: 0.2883 Validation Accuracy: 0.871000 Epoch 31, CIFAR-10 Batch 25: Loss: 0.2079 Validation Accuracy: 0.868800 Epoch 31, CIFAR-10 Batch 26: Loss: 0.1913 Validation Accuracy: 0.880800 Epoch 31, CIFAR-10 Batch 27: Loss: 0.1673 Validation Accuracy: 0.863400 Epoch 31, CIFAR-10 Batch 28: Loss: 0.3416 Validation Accuracy: 0.868600 Epoch 31, CIFAR-10 Batch 29: Loss: 0.2056 Validation Accuracy: 0.869600 Epoch 31, CIFAR-10 Batch 30: Loss: 0.1595 Validation Accuracy: 0.869000 Epoch 31, CIFAR-10 Batch 31: Loss: 0.2002 Validation Accuracy: 0.866200 Epoch 31, CIFAR-10 Batch 32: Loss: 0.1931 Validation Accuracy: 0.869800 Epoch 31, CIFAR-10 Batch 33: Loss: 0.3112 Validation Accuracy: 0.876400 Epoch 31, CIFAR-10 Batch 34: Loss: 0.3639 Validation Accuracy: 0.867000 Epoch 31, CIFAR-10 Batch 35: Loss: 0.3292 Validation Accuracy: 0.864200 Epoch 31, CIFAR-10 Batch 36: Loss: 0.3158 Validation Accuracy: 0.872400 Epoch 31, CIFAR-10 Batch 37: Loss: 0.1875 Validation Accuracy: 0.873800 Epoch 31, CIFAR-10 Batch 38: Loss: 0.1507 Validation Accuracy: 0.867800 Epoch 31, CIFAR-10 Batch 39: Loss: 0.1906 Validation Accuracy: 0.861400 Epoch 31, CIFAR-10 Batch 40: Loss: 0.3062 Validation Accuracy: 0.863600 Epoch 31, CIFAR-10 Batch 41: Loss: 0.2323 Validation Accuracy: 0.865200 Epoch 31, CIFAR-10 Batch 42: Loss: 0.2498 Validation Accuracy: 0.862200 Epoch 31, CIFAR-10 Batch 43: Loss: 0.3497 Validation Accuracy: 0.884400 Epoch 31, CIFAR-10 Batch 44: Loss: 0.2196 Validation Accuracy: 0.870000 Epoch 31, CIFAR-10 Batch 45: Loss: 0.2169 Validation Accuracy: 0.871800 Epoch 31, CIFAR-10 Batch 46: Loss: 0.2734 Validation Accuracy: 0.858400 Epoch 31, CIFAR-10 Batch 47: Loss: 0.1854 Validation Accuracy: 0.872000 Epoch 31, CIFAR-10 Batch 48: Loss: 0.2482 Validation Accuracy: 0.875400 Epoch 31, CIFAR-10 Batch 49: Loss: 0.2968 Validation Accuracy: 0.848800 Epoch 31, CIFAR-10 Batch 50: Loss: 0.2762 Validation Accuracy: 0.878600 Epoch 32, CIFAR-10 Batch 1: Loss: 0.1467 Validation Accuracy: 0.861200 Epoch 32, CIFAR-10 Batch 2: Loss: 0.2273 Validation Accuracy: 0.870400 Epoch 32, CIFAR-10 Batch 3: Loss: 0.2057 Validation Accuracy: 0.875000 Epoch 32, CIFAR-10 Batch 4: Loss: 0.1730 Validation Accuracy: 0.849000 Epoch 32, CIFAR-10 Batch 5: Loss: 0.1932 Validation Accuracy: 0.873400 Epoch 32, CIFAR-10 Batch 6: Loss: 0.3887 Validation Accuracy: 0.873800 Epoch 32, CIFAR-10 Batch 7: Loss: 0.1899 Validation Accuracy: 0.863600 Epoch 32, CIFAR-10 Batch 8: Loss: 0.2765 Validation Accuracy: 0.869400 Epoch 32, CIFAR-10 Batch 9: Loss: 0.2022 Validation Accuracy: 0.866000 Epoch 32, CIFAR-10 Batch 10: Loss: 0.1461 Validation Accuracy: 0.868200 Epoch 32, CIFAR-10 Batch 11: Loss: 0.2198 Validation Accuracy: 0.867000 Epoch 32, CIFAR-10 Batch 12: Loss: 0.2266 Validation Accuracy: 0.861000 Epoch 32, CIFAR-10 Batch 13: Loss: 0.2143 Validation Accuracy: 0.876400 Epoch 32, CIFAR-10 Batch 14: Loss: 0.2611 Validation Accuracy: 0.866400 Epoch 32, CIFAR-10 Batch 15: Loss: 0.2213 Validation Accuracy: 0.873600 Epoch 32, CIFAR-10 Batch 16: Loss: 0.2107 Validation Accuracy: 0.874600 Epoch 32, CIFAR-10 Batch 17: Loss: 0.3042 Validation Accuracy: 0.878400 Epoch 32, CIFAR-10 Batch 18: Loss: 0.2166 Validation Accuracy: 0.867200 Epoch 32, CIFAR-10 Batch 19: Loss: 0.1484 Validation Accuracy: 0.872200 Epoch 32, CIFAR-10 Batch 20: Loss: 0.2967 Validation Accuracy: 0.864400 Epoch 32, CIFAR-10 Batch 21: Loss: 0.1864 Validation Accuracy: 0.871400 Epoch 32, CIFAR-10 Batch 22: Loss: 0.2450 Validation Accuracy: 0.870400 Epoch 32, CIFAR-10 Batch 23: Loss: 0.2348 Validation Accuracy: 0.858600 Epoch 32, CIFAR-10 Batch 24: Loss: 0.2314 Validation Accuracy: 0.879000 Epoch 32, CIFAR-10 Batch 25: Loss: 0.2439 Validation Accuracy: 0.877200 Epoch 32, CIFAR-10 Batch 26: Loss: 0.1947 Validation Accuracy: 0.876400 Epoch 32, CIFAR-10 Batch 27: Loss: 0.1590 Validation Accuracy: 0.863800 Epoch 32, CIFAR-10 Batch 28: Loss: 0.3181 Validation Accuracy: 0.870200 Epoch 32, CIFAR-10 Batch 29: Loss: 0.2132 Validation Accuracy: 0.859600 Epoch 32, CIFAR-10 Batch 30: Loss: 0.1518 Validation Accuracy: 0.861800 Epoch 32, CIFAR-10 Batch 31: Loss: 0.1993 Validation Accuracy: 0.833600 Epoch 32, CIFAR-10 Batch 32: Loss: 0.1638 Validation Accuracy: 0.857400 Epoch 32, CIFAR-10 Batch 33: Loss: 0.3506 Validation Accuracy: 0.871400 Epoch 32, CIFAR-10 Batch 34: Loss: 0.3393 Validation Accuracy: 0.866000 Epoch 32, CIFAR-10 Batch 35: Loss: 0.3358 Validation Accuracy: 0.875600 Epoch 32, CIFAR-10 Batch 36: Loss: 0.2759 Validation Accuracy: 0.863200 Epoch 32, CIFAR-10 Batch 37: Loss: 0.2104 Validation Accuracy: 0.876400 Epoch 32, CIFAR-10 Batch 38: Loss: 0.1469 Validation Accuracy: 0.878400 Epoch 32, CIFAR-10 Batch 39: Loss: 0.1468 Validation Accuracy: 0.872000 Epoch 32, CIFAR-10 Batch 40: Loss: 0.2280 Validation Accuracy: 0.853800 Epoch 32, CIFAR-10 Batch 41: Loss: 0.1929 Validation Accuracy: 0.872200 Epoch 32, CIFAR-10 Batch 42: Loss: 0.2628 Validation Accuracy: 0.862600 Epoch 32, CIFAR-10 Batch 43: Loss: 0.2862 Validation Accuracy: 0.865600 Epoch 32, CIFAR-10 Batch 44: Loss: 0.2543 Validation Accuracy: 0.858600 Epoch 32, CIFAR-10 Batch 45: Loss: 0.1713 Validation Accuracy: 0.870400 Epoch 32, CIFAR-10 Batch 46: Loss: 0.2619 Validation Accuracy: 0.869000 Epoch 32, CIFAR-10 Batch 47: Loss: 0.1953 Validation Accuracy: 0.872800 Epoch 32, CIFAR-10 Batch 48: Loss: 0.2643 Validation Accuracy: 0.864200 Epoch 32, CIFAR-10 Batch 49: Loss: 0.2948 Validation Accuracy: 0.875000 Epoch 32, CIFAR-10 Batch 50: Loss: 0.1998 Validation Accuracy: 0.877000 Epoch 33, CIFAR-10 Batch 1: Loss: 0.1843 Validation Accuracy: 0.885200 Epoch 33, CIFAR-10 Batch 2: Loss: 0.1608 Validation Accuracy: 0.885200 Epoch 33, CIFAR-10 Batch 3: Loss: 0.1554 Validation Accuracy: 0.878600 Epoch 33, CIFAR-10 Batch 4: Loss: 0.1803 Validation Accuracy: 0.870400 Epoch 33, CIFAR-10 Batch 5: Loss: 0.2019 Validation Accuracy: 0.865400 Epoch 33, CIFAR-10 Batch 6: Loss: 0.3900 Validation Accuracy: 0.871000 Epoch 33, CIFAR-10 Batch 7: Loss: 0.1516 Validation Accuracy: 0.860200 Epoch 33, CIFAR-10 Batch 8: Loss: 0.3159 Validation Accuracy: 0.875800 Epoch 33, CIFAR-10 Batch 9: Loss: 0.1899 Validation Accuracy: 0.862200 Epoch 33, CIFAR-10 Batch 10: Loss: 0.1508 Validation Accuracy: 0.865000 Epoch 33, CIFAR-10 Batch 11: Loss: 0.2517 Validation Accuracy: 0.872400 Epoch 33, CIFAR-10 Batch 12: Loss: 0.1889 Validation Accuracy: 0.860800 Epoch 33, CIFAR-10 Batch 13: Loss: 0.2177 Validation Accuracy: 0.880000 Epoch 33, CIFAR-10 Batch 14: Loss: 0.2378 Validation Accuracy: 0.866000 Epoch 33, CIFAR-10 Batch 15: Loss: 0.1777 Validation Accuracy: 0.854800 Epoch 33, CIFAR-10 Batch 16: Loss: 0.1899 Validation Accuracy: 0.866200 Epoch 33, CIFAR-10 Batch 17: Loss: 0.4032 Validation Accuracy: 0.867800 Epoch 33, CIFAR-10 Batch 18: Loss: 0.1839 Validation Accuracy: 0.862200 Epoch 33, CIFAR-10 Batch 19: Loss: 0.1497 Validation Accuracy: 0.863200 Epoch 33, CIFAR-10 Batch 20: Loss: 0.2883 Validation Accuracy: 0.874200 Epoch 33, CIFAR-10 Batch 21: Loss: 0.1558 Validation Accuracy: 0.869200 Epoch 33, CIFAR-10 Batch 22: Loss: 0.2234 Validation Accuracy: 0.870400 Epoch 33, CIFAR-10 Batch 23: Loss: 0.2573 Validation Accuracy: 0.852200 Epoch 33, CIFAR-10 Batch 24: Loss: 0.2530 Validation Accuracy: 0.877600 Epoch 33, CIFAR-10 Batch 25: Loss: 0.2511 Validation Accuracy: 0.846800 Epoch 33, CIFAR-10 Batch 26: Loss: 0.1888 Validation Accuracy: 0.877800 Epoch 33, CIFAR-10 Batch 27: Loss: 0.1391 Validation Accuracy: 0.845800 Epoch 33, CIFAR-10 Batch 28: Loss: 0.3190 Validation Accuracy: 0.879200 Epoch 33, CIFAR-10 Batch 29: Loss: 0.2146 Validation Accuracy: 0.872600 Epoch 33, CIFAR-10 Batch 30: Loss: 0.1494 Validation Accuracy: 0.879200 Epoch 33, CIFAR-10 Batch 31: Loss: 0.1656 Validation Accuracy: 0.871800 Epoch 33, CIFAR-10 Batch 32: Loss: 0.1454 Validation Accuracy: 0.879400 Epoch 33, CIFAR-10 Batch 33: Loss: 0.2875 Validation Accuracy: 0.860800 Epoch 33, CIFAR-10 Batch 34: Loss: 0.3535 Validation Accuracy: 0.854800 Epoch 33, CIFAR-10 Batch 35: Loss: 0.3138 Validation Accuracy: 0.862600 Epoch 33, CIFAR-10 Batch 36: Loss: 0.2747 Validation Accuracy: 0.874400 Epoch 33, CIFAR-10 Batch 37: Loss: 0.2044 Validation Accuracy: 0.872800 Epoch 33, CIFAR-10 Batch 38: Loss: 0.1556 Validation Accuracy: 0.866200 Epoch 33, CIFAR-10 Batch 39: Loss: 0.1399 Validation Accuracy: 0.870200 Epoch 33, CIFAR-10 Batch 40: Loss: 0.2859 Validation Accuracy: 0.871400 Epoch 33, CIFAR-10 Batch 41: Loss: 0.2395 Validation Accuracy: 0.869600 Epoch 33, CIFAR-10 Batch 42: Loss: 0.2283 Validation Accuracy: 0.870200 Epoch 33, CIFAR-10 Batch 43: Loss: 0.2950 Validation Accuracy: 0.882400 Epoch 33, CIFAR-10 Batch 44: Loss: 0.2377 Validation Accuracy: 0.859400 Epoch 33, CIFAR-10 Batch 45: Loss: 0.2120 Validation Accuracy: 0.871000 Epoch 33, CIFAR-10 Batch 46: Loss: 0.2467 Validation Accuracy: 0.868200 Epoch 33, CIFAR-10 Batch 47: Loss: 0.2206 Validation Accuracy: 0.870400 Epoch 33, CIFAR-10 Batch 48: Loss: 0.2146 Validation Accuracy: 0.869800 Epoch 33, CIFAR-10 Batch 49: Loss: 0.3281 Validation Accuracy: 0.873600 Epoch 33, CIFAR-10 Batch 50: Loss: 0.1853 Validation Accuracy: 0.864000 Epoch 34, CIFAR-10 Batch 1: Loss: 0.2017 Validation Accuracy: 0.878800 Epoch 34, CIFAR-10 Batch 2: Loss: 0.2099 Validation Accuracy: 0.849600 Epoch 34, CIFAR-10 Batch 3: Loss: 0.1762 Validation Accuracy: 0.877800 Epoch 34, CIFAR-10 Batch 4: Loss: 0.1552 Validation Accuracy: 0.878800 Epoch 34, CIFAR-10 Batch 5: Loss: 0.2433 Validation Accuracy: 0.880000 Epoch 34, CIFAR-10 Batch 6: Loss: 0.3420 Validation Accuracy: 0.872000 Epoch 34, CIFAR-10 Batch 7: Loss: 0.1781 Validation Accuracy: 0.870000 Epoch 34, CIFAR-10 Batch 8: Loss: 0.2693 Validation Accuracy: 0.868200 Epoch 34, CIFAR-10 Batch 9: Loss: 0.1974 Validation Accuracy: 0.874000 Epoch 34, CIFAR-10 Batch 10: Loss: 0.1410 Validation Accuracy: 0.878800 Epoch 34, CIFAR-10 Batch 11: Loss: 0.2205 Validation Accuracy: 0.875600 Epoch 34, CIFAR-10 Batch 12: Loss: 0.2168 Validation Accuracy: 0.867200 Epoch 34, CIFAR-10 Batch 13: Loss: 0.2179 Validation Accuracy: 0.869200 Epoch 34, CIFAR-10 Batch 14: Loss: 0.2163 Validation Accuracy: 0.878200 Epoch 34, CIFAR-10 Batch 15: Loss: 0.2282 Validation Accuracy: 0.882200 Epoch 34, CIFAR-10 Batch 16: Loss: 0.1848 Validation Accuracy: 0.858600 Epoch 34, CIFAR-10 Batch 17: Loss: 0.3001 Validation Accuracy: 0.880400 Epoch 34, CIFAR-10 Batch 18: Loss: 0.2071 Validation Accuracy: 0.856400 Epoch 34, CIFAR-10 Batch 19: Loss: 0.1515 Validation Accuracy: 0.866200 Epoch 34, CIFAR-10 Batch 20: Loss: 0.3059 Validation Accuracy: 0.875200 Epoch 34, CIFAR-10 Batch 21: Loss: 0.1684 Validation Accuracy: 0.872400 Epoch 34, CIFAR-10 Batch 22: Loss: 0.2094 Validation Accuracy: 0.868000 Epoch 34, CIFAR-10 Batch 23: Loss: 0.2221 Validation Accuracy: 0.871000 Epoch 34, CIFAR-10 Batch 24: Loss: 0.2010 Validation Accuracy: 0.881600 Epoch 34, CIFAR-10 Batch 25: Loss: 0.2683 Validation Accuracy: 0.874800 Epoch 34, CIFAR-10 Batch 26: Loss: 0.2019 Validation Accuracy: 0.877800 Epoch 34, CIFAR-10 Batch 27: Loss: 0.1667 Validation Accuracy: 0.873200 Epoch 34, CIFAR-10 Batch 28: Loss: 0.3222 Validation Accuracy: 0.876200 Epoch 34, CIFAR-10 Batch 29: Loss: 0.2633 Validation Accuracy: 0.874200 Epoch 34, CIFAR-10 Batch 30: Loss: 0.1582 Validation Accuracy: 0.872800 Epoch 34, CIFAR-10 Batch 31: Loss: 0.1847 Validation Accuracy: 0.865000 Epoch 34, CIFAR-10 Batch 32: Loss: 0.2062 Validation Accuracy: 0.872800 Epoch 34, CIFAR-10 Batch 33: Loss: 0.3006 Validation Accuracy: 0.864200 Epoch 34, CIFAR-10 Batch 34: Loss: 0.3342 Validation Accuracy: 0.865400 Epoch 34, CIFAR-10 Batch 35: Loss: 0.2983 Validation Accuracy: 0.879400 Epoch 34, CIFAR-10 Batch 36: Loss: 0.2764 Validation Accuracy: 0.860400 Epoch 34, CIFAR-10 Batch 37: Loss: 0.2021 Validation Accuracy: 0.854800 Epoch 34, CIFAR-10 Batch 38: Loss: 0.1469 Validation Accuracy: 0.881400 Epoch 34, CIFAR-10 Batch 39: Loss: 0.1684 Validation Accuracy: 0.870400 Epoch 34, CIFAR-10 Batch 40: Loss: 0.2601 Validation Accuracy: 0.859200 Epoch 34, CIFAR-10 Batch 41: Loss: 0.2012 Validation Accuracy: 0.875800 Epoch 34, CIFAR-10 Batch 42: Loss: 0.2008 Validation Accuracy: 0.878800 Epoch 34, CIFAR-10 Batch 43: Loss: 0.2897 Validation Accuracy: 0.885200 Epoch 34, CIFAR-10 Batch 44: Loss: 0.2230 Validation Accuracy: 0.863800 Epoch 34, CIFAR-10 Batch 45: Loss: 0.1988 Validation Accuracy: 0.877600 Epoch 34, CIFAR-10 Batch 46: Loss: 0.2578 Validation Accuracy: 0.876200 Epoch 34, CIFAR-10 Batch 47: Loss: 0.1848 Validation Accuracy: 0.876400 Epoch 34, CIFAR-10 Batch 48: Loss: 0.2146 Validation Accuracy: 0.869800 Epoch 34, CIFAR-10 Batch 49: Loss: 0.3295 Validation Accuracy: 0.875400 Epoch 34, CIFAR-10 Batch 50: Loss: 0.2082 Validation Accuracy: 0.871400 Epoch 35, CIFAR-10 Batch 1: Loss: 0.1657 Validation Accuracy: 0.870000 Epoch 35, CIFAR-10 Batch 2: Loss: 0.1830 Validation Accuracy: 0.861200 Epoch 35, CIFAR-10 Batch 3: Loss: 0.2055 Validation Accuracy: 0.868000 Epoch 35, CIFAR-10 Batch 4: Loss: 0.1693 Validation Accuracy: 0.866400 Epoch 35, CIFAR-10 Batch 5: Loss: 0.1888 Validation Accuracy: 0.886000 Epoch 35, CIFAR-10 Batch 6: Loss: 0.2731 Validation Accuracy: 0.878200 Epoch 35, CIFAR-10 Batch 7: Loss: 0.2048 Validation Accuracy: 0.855600 Epoch 35, CIFAR-10 Batch 8: Loss: 0.2869 Validation Accuracy: 0.875000 Epoch 35, CIFAR-10 Batch 9: Loss: 0.1876 Validation Accuracy: 0.879000 Epoch 35, CIFAR-10 Batch 10: Loss: 0.1608 Validation Accuracy: 0.877400 Epoch 35, CIFAR-10 Batch 11: Loss: 0.2122 Validation Accuracy: 0.874800 Epoch 35, CIFAR-10 Batch 12: Loss: 0.1823 Validation Accuracy: 0.852600 Epoch 35, CIFAR-10 Batch 13: Loss: 0.2431 Validation Accuracy: 0.859000 Epoch 35, CIFAR-10 Batch 14: Loss: 0.1979 Validation Accuracy: 0.859600 Epoch 35, CIFAR-10 Batch 15: Loss: 0.2054 Validation Accuracy: 0.881000 Epoch 35, CIFAR-10 Batch 16: Loss: 0.1767 Validation Accuracy: 0.870200 Epoch 35, CIFAR-10 Batch 17: Loss: 0.2871 Validation Accuracy: 0.878600 Epoch 35, CIFAR-10 Batch 18: Loss: 0.1954 Validation Accuracy: 0.876600 Epoch 35, CIFAR-10 Batch 19: Loss: 0.1935 Validation Accuracy: 0.876600 Epoch 35, CIFAR-10 Batch 20: Loss: 0.2834 Validation Accuracy: 0.875000 Epoch 35, CIFAR-10 Batch 21: Loss: 0.1756 Validation Accuracy: 0.874800 Epoch 35, CIFAR-10 Batch 22: Loss: 0.2025 Validation Accuracy: 0.874600 Epoch 35, CIFAR-10 Batch 23: Loss: 0.2516 Validation Accuracy: 0.866400 Epoch 35, CIFAR-10 Batch 24: Loss: 0.2735 Validation Accuracy: 0.864600 Epoch 35, CIFAR-10 Batch 25: Loss: 0.2395 Validation Accuracy: 0.870800 Epoch 35, CIFAR-10 Batch 26: Loss: 0.1859 Validation Accuracy: 0.875200 Epoch 35, CIFAR-10 Batch 27: Loss: 0.1472 Validation Accuracy: 0.855400 Epoch 35, CIFAR-10 Batch 28: Loss: 0.3224 Validation Accuracy: 0.861200 Epoch 35, CIFAR-10 Batch 29: Loss: 0.1601 Validation Accuracy: 0.870000 Epoch 35, CIFAR-10 Batch 30: Loss: 0.1506 Validation Accuracy: 0.873400 Epoch 35, CIFAR-10 Batch 31: Loss: 0.1783 Validation Accuracy: 0.869200 Epoch 35, CIFAR-10 Batch 32: Loss: 0.1553 Validation Accuracy: 0.877600 Epoch 35, CIFAR-10 Batch 33: Loss: 0.3242 Validation Accuracy: 0.867600 Epoch 35, CIFAR-10 Batch 34: Loss: 0.3465 Validation Accuracy: 0.859200 Epoch 35, CIFAR-10 Batch 35: Loss: 0.3122 Validation Accuracy: 0.874600 Epoch 35, CIFAR-10 Batch 36: Loss: 0.3434 Validation Accuracy: 0.867000 Epoch 35, CIFAR-10 Batch 37: Loss: 0.1873 Validation Accuracy: 0.875400 Epoch 35, CIFAR-10 Batch 38: Loss: 0.1487 Validation Accuracy: 0.876400 Epoch 35, CIFAR-10 Batch 39: Loss: 0.1487 Validation Accuracy: 0.864600 Epoch 35, CIFAR-10 Batch 40: Loss: 0.1918 Validation Accuracy: 0.871000 Epoch 35, CIFAR-10 Batch 41: Loss: 0.2293 Validation Accuracy: 0.856400 Epoch 35, CIFAR-10 Batch 42: Loss: 0.2273 Validation Accuracy: 0.877800 Epoch 35, CIFAR-10 Batch 43: Loss: 0.2516 Validation Accuracy: 0.869800 Epoch 35, CIFAR-10 Batch 44: Loss: 0.2233 Validation Accuracy: 0.870200 Epoch 35, CIFAR-10 Batch 45: Loss: 0.2061 Validation Accuracy: 0.881600 Epoch 35, CIFAR-10 Batch 46: Loss: 0.2566 Validation Accuracy: 0.879400 Epoch 35, CIFAR-10 Batch 47: Loss: 0.1711 Validation Accuracy: 0.873000 Epoch 35, CIFAR-10 Batch 48: Loss: 0.2538 Validation Accuracy: 0.876600 Epoch 35, CIFAR-10 Batch 49: Loss: 0.2097 Validation Accuracy: 0.857600 Epoch 35, CIFAR-10 Batch 50: Loss: 0.1649 Validation Accuracy: 0.868400 Epoch 36, CIFAR-10 Batch 1: Loss: 0.1682 Validation Accuracy: 0.879000 Epoch 36, CIFAR-10 Batch 2: Loss: 0.2077 Validation Accuracy: 0.869600 Epoch 36, CIFAR-10 Batch 3: Loss: 0.1404 Validation Accuracy: 0.874800 Epoch 36, CIFAR-10 Batch 4: Loss: 0.1670 Validation Accuracy: 0.879000 Epoch 36, CIFAR-10 Batch 5: Loss: 0.2183 Validation Accuracy: 0.877800 Epoch 36, CIFAR-10 Batch 6: Loss: 0.3558 Validation Accuracy: 0.860600 Epoch 36, CIFAR-10 Batch 7: Loss: 0.1804 Validation Accuracy: 0.862000 Epoch 36, CIFAR-10 Batch 8: Loss: 0.2530 Validation Accuracy: 0.864800 Epoch 36, CIFAR-10 Batch 9: Loss: 0.2510 Validation Accuracy: 0.870400 Epoch 36, CIFAR-10 Batch 10: Loss: 0.1406 Validation Accuracy: 0.873200 Epoch 36, CIFAR-10 Batch 11: Loss: 0.2185 Validation Accuracy: 0.873800 Epoch 36, CIFAR-10 Batch 12: Loss: 0.2259 Validation Accuracy: 0.837000 Epoch 36, CIFAR-10 Batch 13: Loss: 0.1863 Validation Accuracy: 0.879400 Epoch 36, CIFAR-10 Batch 14: Loss: 0.2030 Validation Accuracy: 0.877000 Epoch 36, CIFAR-10 Batch 15: Loss: 0.1674 Validation Accuracy: 0.867400 Epoch 36, CIFAR-10 Batch 16: Loss: 0.1675 Validation Accuracy: 0.843800 Epoch 36, CIFAR-10 Batch 17: Loss: 0.2903 Validation Accuracy: 0.875600 Epoch 36, CIFAR-10 Batch 18: Loss: 0.1601 Validation Accuracy: 0.867600 Epoch 36, CIFAR-10 Batch 19: Loss: 0.1553 Validation Accuracy: 0.875000 Epoch 36, CIFAR-10 Batch 20: Loss: 0.2157 Validation Accuracy: 0.875400 Epoch 36, CIFAR-10 Batch 21: Loss: 0.1767 Validation Accuracy: 0.873000 Epoch 36, CIFAR-10 Batch 22: Loss: 0.2110 Validation Accuracy: 0.881600 Epoch 36, CIFAR-10 Batch 23: Loss: 0.2179 Validation Accuracy: 0.880400 Epoch 36, CIFAR-10 Batch 24: Loss: 0.2945 Validation Accuracy: 0.885800 Epoch 36, CIFAR-10 Batch 25: Loss: 0.2411 Validation Accuracy: 0.871200 Epoch 36, CIFAR-10 Batch 26: Loss: 0.1856 Validation Accuracy: 0.873600 Epoch 36, CIFAR-10 Batch 27: Loss: 0.1672 Validation Accuracy: 0.879400 Epoch 36, CIFAR-10 Batch 28: Loss: 0.3303 Validation Accuracy: 0.881000 Epoch 36, CIFAR-10 Batch 29: Loss: 0.1673 Validation Accuracy: 0.869200 Epoch 36, CIFAR-10 Batch 30: Loss: 0.1424 Validation Accuracy: 0.871000 Epoch 36, CIFAR-10 Batch 31: Loss: 0.2060 Validation Accuracy: 0.860600 Epoch 36, CIFAR-10 Batch 32: Loss: 0.1815 Validation Accuracy: 0.875800 Epoch 36, CIFAR-10 Batch 33: Loss: 0.3502 Validation Accuracy: 0.865800 Epoch 36, CIFAR-10 Batch 34: Loss: 0.3330 Validation Accuracy: 0.867600 Epoch 36, CIFAR-10 Batch 35: Loss: 0.2808 Validation Accuracy: 0.876800 Epoch 36, CIFAR-10 Batch 36: Loss: 0.2547 Validation Accuracy: 0.874000 Epoch 36, CIFAR-10 Batch 37: Loss: 0.1591 Validation Accuracy: 0.875200 Epoch 36, CIFAR-10 Batch 38: Loss: 0.1553 Validation Accuracy: 0.869000 Epoch 36, CIFAR-10 Batch 39: Loss: 0.1573 Validation Accuracy: 0.865600 Epoch 36, CIFAR-10 Batch 40: Loss: 0.2586 Validation Accuracy: 0.846800 Epoch 36, CIFAR-10 Batch 41: Loss: 0.2206 Validation Accuracy: 0.871200 Epoch 36, CIFAR-10 Batch 42: Loss: 0.2160 Validation Accuracy: 0.875800 Epoch 36, CIFAR-10 Batch 43: Loss: 0.2645 Validation Accuracy: 0.866800 Epoch 36, CIFAR-10 Batch 44: Loss: 0.1950 Validation Accuracy: 0.869600 Epoch 36, CIFAR-10 Batch 45: Loss: 0.1989 Validation Accuracy: 0.866800 Epoch 36, CIFAR-10 Batch 46: Loss: 0.2447 Validation Accuracy: 0.876800 Epoch 36, CIFAR-10 Batch 47: Loss: 0.1836 Validation Accuracy: 0.880800 Epoch 36, CIFAR-10 Batch 48: Loss: 0.2525 Validation Accuracy: 0.879200 Epoch 36, CIFAR-10 Batch 49: Loss: 0.2241 Validation Accuracy: 0.869800 Epoch 36, CIFAR-10 Batch 50: Loss: 0.1939 Validation Accuracy: 0.883200 Epoch 37, CIFAR-10 Batch 1: Loss: 0.1841 Validation Accuracy: 0.875200 Epoch 37, CIFAR-10 Batch 2: Loss: 0.1960 Validation Accuracy: 0.877800 Epoch 37, CIFAR-10 Batch 3: Loss: 0.1823 Validation Accuracy: 0.871600 Epoch 37, CIFAR-10 Batch 4: Loss: 0.1736 Validation Accuracy: 0.871400 Epoch 37, CIFAR-10 Batch 5: Loss: 0.2168 Validation Accuracy: 0.880800 Epoch 37, CIFAR-10 Batch 6: Loss: 0.3670 Validation Accuracy: 0.858200 Epoch 37, CIFAR-10 Batch 7: Loss: 0.1631 Validation Accuracy: 0.852200 Epoch 37, CIFAR-10 Batch 8: Loss: 0.2436 Validation Accuracy: 0.884200 Epoch 37, CIFAR-10 Batch 9: Loss: 0.2160 Validation Accuracy: 0.878200 Epoch 37, CIFAR-10 Batch 10: Loss: 0.1349 Validation Accuracy: 0.885600 Epoch 37, CIFAR-10 Batch 11: Loss: 0.2434 Validation Accuracy: 0.872200 Epoch 37, CIFAR-10 Batch 12: Loss: 0.2980 Validation Accuracy: 0.877000 Epoch 37, CIFAR-10 Batch 13: Loss: 0.2651 Validation Accuracy: 0.876400 Epoch 37, CIFAR-10 Batch 14: Loss: 0.2027 Validation Accuracy: 0.872000 Epoch 37, CIFAR-10 Batch 15: Loss: 0.1694 Validation Accuracy: 0.869600 Epoch 37, CIFAR-10 Batch 16: Loss: 0.1567 Validation Accuracy: 0.874000 Epoch 37, CIFAR-10 Batch 17: Loss: 0.3017 Validation Accuracy: 0.875400 Epoch 37, CIFAR-10 Batch 18: Loss: 0.1830 Validation Accuracy: 0.860200 Epoch 37, CIFAR-10 Batch 19: Loss: 0.1630 Validation Accuracy: 0.864600 Epoch 37, CIFAR-10 Batch 20: Loss: 0.2504 Validation Accuracy: 0.865200 Epoch 37, CIFAR-10 Batch 21: Loss: 0.1473 Validation Accuracy: 0.877200 Epoch 37, CIFAR-10 Batch 22: Loss: 0.1909 Validation Accuracy: 0.879000 Epoch 37, CIFAR-10 Batch 23: Loss: 0.1854 Validation Accuracy: 0.870400 Epoch 37, CIFAR-10 Batch 24: Loss: 0.2260 Validation Accuracy: 0.887200 Epoch 37, CIFAR-10 Batch 25: Loss: 0.2706 Validation Accuracy: 0.870600 Epoch 37, CIFAR-10 Batch 26: Loss: 0.1813 Validation Accuracy: 0.883800 Epoch 37, CIFAR-10 Batch 27: Loss: 0.1559 Validation Accuracy: 0.862600 Epoch 37, CIFAR-10 Batch 28: Loss: 0.3487 Validation Accuracy: 0.875400 Epoch 37, CIFAR-10 Batch 29: Loss: 0.1754 Validation Accuracy: 0.871200 Epoch 37, CIFAR-10 Batch 30: Loss: 0.1483 Validation Accuracy: 0.872400 Epoch 37, CIFAR-10 Batch 31: Loss: 0.2046 Validation Accuracy: 0.865400 Epoch 37, CIFAR-10 Batch 32: Loss: 0.1710 Validation Accuracy: 0.864400 Epoch 37, CIFAR-10 Batch 33: Loss: 0.3569 Validation Accuracy: 0.864600 Epoch 37, CIFAR-10 Batch 34: Loss: 0.3462 Validation Accuracy: 0.872400 Epoch 37, CIFAR-10 Batch 35: Loss: 0.2719 Validation Accuracy: 0.875600 Epoch 37, CIFAR-10 Batch 36: Loss: 0.2510 Validation Accuracy: 0.880800 Epoch 37, CIFAR-10 Batch 37: Loss: 0.1745 Validation Accuracy: 0.868000 Epoch 37, CIFAR-10 Batch 38: Loss: 0.1708 Validation Accuracy: 0.879400 Epoch 37, CIFAR-10 Batch 39: Loss: 0.1562 Validation Accuracy: 0.866800 Epoch 37, CIFAR-10 Batch 40: Loss: 0.2261 Validation Accuracy: 0.851200 Epoch 37, CIFAR-10 Batch 41: Loss: 0.2203 Validation Accuracy: 0.869600 Epoch 37, CIFAR-10 Batch 42: Loss: 0.2442 Validation Accuracy: 0.870800 Epoch 37, CIFAR-10 Batch 43: Loss: 0.2725 Validation Accuracy: 0.881600 Epoch 37, CIFAR-10 Batch 44: Loss: 0.2392 Validation Accuracy: 0.870400 Epoch 37, CIFAR-10 Batch 45: Loss: 0.1806 Validation Accuracy: 0.877400 Epoch 37, CIFAR-10 Batch 46: Loss: 0.1979 Validation Accuracy: 0.869600 Epoch 37, CIFAR-10 Batch 47: Loss: 0.2143 Validation Accuracy: 0.870200 Epoch 37, CIFAR-10 Batch 48: Loss: 0.2116 Validation Accuracy: 0.862800 Epoch 37, CIFAR-10 Batch 49: Loss: 0.2290 Validation Accuracy: 0.872800 Epoch 37, CIFAR-10 Batch 50: Loss: 0.2138 Validation Accuracy: 0.873200 Epoch 38, CIFAR-10 Batch 1: Loss: 0.1856 Validation Accuracy: 0.864200 Epoch 38, CIFAR-10 Batch 2: Loss: 0.2205 Validation Accuracy: 0.868600 Epoch 38, CIFAR-10 Batch 3: Loss: 0.1936 Validation Accuracy: 0.875800 Epoch 38, CIFAR-10 Batch 4: Loss: 0.1437 Validation Accuracy: 0.876000 Epoch 38, CIFAR-10 Batch 5: Loss: 0.1875 Validation Accuracy: 0.887400 Epoch 38, CIFAR-10 Batch 6: Loss: 0.3098 Validation Accuracy: 0.876200 Epoch 38, CIFAR-10 Batch 7: Loss: 0.1742 Validation Accuracy: 0.868200 Epoch 38, CIFAR-10 Batch 8: Loss: 0.3023 Validation Accuracy: 0.875800 Epoch 38, CIFAR-10 Batch 9: Loss: 0.2440 Validation Accuracy: 0.870000 Epoch 38, CIFAR-10 Batch 10: Loss: 0.1487 Validation Accuracy: 0.875800 Epoch 38, CIFAR-10 Batch 11: Loss: 0.2479 Validation Accuracy: 0.872400 Epoch 38, CIFAR-10 Batch 12: Loss: 0.2010 Validation Accuracy: 0.856400 Epoch 38, CIFAR-10 Batch 13: Loss: 0.2356 Validation Accuracy: 0.831400 Epoch 38, CIFAR-10 Batch 14: Loss: 0.1783 Validation Accuracy: 0.872200 Epoch 38, CIFAR-10 Batch 15: Loss: 0.1861 Validation Accuracy: 0.869600 Epoch 38, CIFAR-10 Batch 16: Loss: 0.1884 Validation Accuracy: 0.859800 Epoch 38, CIFAR-10 Batch 17: Loss: 0.2744 Validation Accuracy: 0.877800 Epoch 38, CIFAR-10 Batch 18: Loss: 0.1765 Validation Accuracy: 0.860400 Epoch 38, CIFAR-10 Batch 19: Loss: 0.1490 Validation Accuracy: 0.872800 Epoch 38, CIFAR-10 Batch 20: Loss: 0.3360 Validation Accuracy: 0.865000 Epoch 38, CIFAR-10 Batch 21: Loss: 0.1641 Validation Accuracy: 0.877400 Epoch 38, CIFAR-10 Batch 22: Loss: 0.2240 Validation Accuracy: 0.866200 Epoch 38, CIFAR-10 Batch 23: Loss: 0.2583 Validation Accuracy: 0.873200 Epoch 38, CIFAR-10 Batch 24: Loss: 0.2295 Validation Accuracy: 0.878800 Epoch 38, CIFAR-10 Batch 25: Loss: 0.2190 Validation Accuracy: 0.858000 Epoch 38, CIFAR-10 Batch 26: Loss: 0.1867 Validation Accuracy: 0.879000 Epoch 38, CIFAR-10 Batch 27: Loss: 0.1465 Validation Accuracy: 0.860400 Epoch 38, CIFAR-10 Batch 28: Loss: 0.2666 Validation Accuracy: 0.888200 Epoch 38, CIFAR-10 Batch 29: Loss: 0.1900 Validation Accuracy: 0.882800 Epoch 38, CIFAR-10 Batch 30: Loss: 0.1456 Validation Accuracy: 0.882000 Epoch 38, CIFAR-10 Batch 31: Loss: 0.1575 Validation Accuracy: 0.873000 Epoch 38, CIFAR-10 Batch 32: Loss: 0.1711 Validation Accuracy: 0.851600 Epoch 38, CIFAR-10 Batch 33: Loss: 0.3085 Validation Accuracy: 0.869800 Epoch 38, CIFAR-10 Batch 34: Loss: 0.3391 Validation Accuracy: 0.875200 Epoch 38, CIFAR-10 Batch 35: Loss: 0.2663 Validation Accuracy: 0.855800 Epoch 38, CIFAR-10 Batch 36: Loss: 0.2768 Validation Accuracy: 0.866800 Epoch 38, CIFAR-10 Batch 37: Loss: 0.1971 Validation Accuracy: 0.871200 Epoch 38, CIFAR-10 Batch 38: Loss: 0.1608 Validation Accuracy: 0.862000 Epoch 38, CIFAR-10 Batch 39: Loss: 0.1441 Validation Accuracy: 0.865800 Epoch 38, CIFAR-10 Batch 40: Loss: 0.2507 Validation Accuracy: 0.875600 Epoch 38, CIFAR-10 Batch 41: Loss: 0.2223 Validation Accuracy: 0.857000 Epoch 38, CIFAR-10 Batch 42: Loss: 0.2146 Validation Accuracy: 0.879200 Epoch 38, CIFAR-10 Batch 43: Loss: 0.3432 Validation Accuracy: 0.884600 Epoch 38, CIFAR-10 Batch 44: Loss: 0.2140 Validation Accuracy: 0.858800 Epoch 38, CIFAR-10 Batch 45: Loss: 0.1547 Validation Accuracy: 0.877400 Epoch 38, CIFAR-10 Batch 46: Loss: 0.2303 Validation Accuracy: 0.880400 Epoch 38, CIFAR-10 Batch 47: Loss: 0.2019 Validation Accuracy: 0.880600 Epoch 38, CIFAR-10 Batch 48: Loss: 0.2001 Validation Accuracy: 0.874400 Epoch 38, CIFAR-10 Batch 49: Loss: 0.2325 Validation Accuracy: 0.881600 Epoch 38, CIFAR-10 Batch 50: Loss: 0.1946 Validation Accuracy: 0.884600 Epoch 39, CIFAR-10 Batch 1: Loss: 0.1751 Validation Accuracy: 0.847400 Epoch 39, CIFAR-10 Batch 2: Loss: 0.1866 Validation Accuracy: 0.866000 Epoch 39, CIFAR-10 Batch 3: Loss: 0.1479 Validation Accuracy: 0.877000 Epoch 39, CIFAR-10 Batch 4: Loss: 0.1929 Validation Accuracy: 0.871600 Epoch 39, CIFAR-10 Batch 5: Loss: 0.1970 Validation Accuracy: 0.882400 Epoch 39, CIFAR-10 Batch 6: Loss: 0.3425 Validation Accuracy: 0.873200 Epoch 39, CIFAR-10 Batch 7: Loss: 0.1494 Validation Accuracy: 0.870800 Epoch 39, CIFAR-10 Batch 8: Loss: 0.2603 Validation Accuracy: 0.879200 Epoch 39, CIFAR-10 Batch 9: Loss: 0.2687 Validation Accuracy: 0.881400 Epoch 39, CIFAR-10 Batch 10: Loss: 0.1527 Validation Accuracy: 0.876000 Epoch 39, CIFAR-10 Batch 11: Loss: 0.2098 Validation Accuracy: 0.875000 Epoch 39, CIFAR-10 Batch 12: Loss: 0.1994 Validation Accuracy: 0.868200 Epoch 39, CIFAR-10 Batch 13: Loss: 0.2043 Validation Accuracy: 0.883600 Epoch 39, CIFAR-10 Batch 14: Loss: 0.2005 Validation Accuracy: 0.864800 Epoch 39, CIFAR-10 Batch 15: Loss: 0.1692 Validation Accuracy: 0.882600 Epoch 39, CIFAR-10 Batch 16: Loss: 0.1649 Validation Accuracy: 0.875400 Epoch 39, CIFAR-10 Batch 17: Loss: 0.2869 Validation Accuracy: 0.872400 Epoch 39, CIFAR-10 Batch 18: Loss: 0.1996 Validation Accuracy: 0.871200 Epoch 39, CIFAR-10 Batch 19: Loss: 0.1458 Validation Accuracy: 0.868600 Epoch 39, CIFAR-10 Batch 20: Loss: 0.2311 Validation Accuracy: 0.860600 Epoch 39, CIFAR-10 Batch 21: Loss: 0.1851 Validation Accuracy: 0.860400 Epoch 39, CIFAR-10 Batch 22: Loss: 0.1808 Validation Accuracy: 0.874400 Epoch 39, CIFAR-10 Batch 23: Loss: 0.2398 Validation Accuracy: 0.883600 Epoch 39, CIFAR-10 Batch 24: Loss: 0.1906 Validation Accuracy: 0.880000 Epoch 39, CIFAR-10 Batch 25: Loss: 0.2164 Validation Accuracy: 0.860200 Epoch 39, CIFAR-10 Batch 26: Loss: 0.1708 Validation Accuracy: 0.882800 Epoch 39, CIFAR-10 Batch 27: Loss: 0.1580 Validation Accuracy: 0.871000 Epoch 39, CIFAR-10 Batch 28: Loss: 0.3131 Validation Accuracy: 0.876800 Epoch 39, CIFAR-10 Batch 29: Loss: 0.1769 Validation Accuracy: 0.868800 Epoch 39, CIFAR-10 Batch 30: Loss: 0.1530 Validation Accuracy: 0.874200 Epoch 39, CIFAR-10 Batch 31: Loss: 0.1508 Validation Accuracy: 0.868600 Epoch 39, CIFAR-10 Batch 32: Loss: 0.1616 Validation Accuracy: 0.864000 Epoch 39, CIFAR-10 Batch 33: Loss: 0.2722 Validation Accuracy: 0.868600 Epoch 39, CIFAR-10 Batch 34: Loss: 0.3553 Validation Accuracy: 0.866600 Epoch 39, CIFAR-10 Batch 35: Loss: 0.2795 Validation Accuracy: 0.873800 Epoch 39, CIFAR-10 Batch 36: Loss: 0.2896 Validation Accuracy: 0.865600 Epoch 39, CIFAR-10 Batch 37: Loss: 0.1772 Validation Accuracy: 0.875000 Epoch 39, CIFAR-10 Batch 38: Loss: 0.1516 Validation Accuracy: 0.880400 Epoch 39, CIFAR-10 Batch 39: Loss: 0.1441 Validation Accuracy: 0.874000 Epoch 39, CIFAR-10 Batch 40: Loss: 0.2280 Validation Accuracy: 0.872400 Epoch 39, CIFAR-10 Batch 41: Loss: 0.2093 Validation Accuracy: 0.861800 Epoch 39, CIFAR-10 Batch 42: Loss: 0.2021 Validation Accuracy: 0.865400 Epoch 39, CIFAR-10 Batch 43: Loss: 0.2832 Validation Accuracy: 0.875600 Epoch 39, CIFAR-10 Batch 44: Loss: 0.2363 Validation Accuracy: 0.866600 Epoch 39, CIFAR-10 Batch 45: Loss: 0.1906 Validation Accuracy: 0.879400 Epoch 39, CIFAR-10 Batch 46: Loss: 0.2073 Validation Accuracy: 0.876200 Epoch 39, CIFAR-10 Batch 47: Loss: 0.1880 Validation Accuracy: 0.874000 Epoch 39, CIFAR-10 Batch 48: Loss: 0.1821 Validation Accuracy: 0.885800 Epoch 39, CIFAR-10 Batch 49: Loss: 0.2253 Validation Accuracy: 0.881000 Epoch 39, CIFAR-10 Batch 50: Loss: 0.1957 Validation Accuracy: 0.872600 Epoch 40, CIFAR-10 Batch 1: Loss: 0.1788 Validation Accuracy: 0.869000 Epoch 40, CIFAR-10 Batch 2: Loss: 0.1865 Validation Accuracy: 0.871800 Epoch 40, CIFAR-10 Batch 3: Loss: 0.1524 Validation Accuracy: 0.877600 Epoch 40, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.871600 Epoch 40, CIFAR-10 Batch 5: Loss: 0.1864 Validation Accuracy: 0.873600 Epoch 40, CIFAR-10 Batch 6: Loss: 0.2958 Validation Accuracy: 0.878200 Epoch 40, CIFAR-10 Batch 7: Loss: 0.1474 Validation Accuracy: 0.867000 Epoch 40, CIFAR-10 Batch 8: Loss: 0.2627 Validation Accuracy: 0.881200 Epoch 40, CIFAR-10 Batch 9: Loss: 0.1534 Validation Accuracy: 0.883200 Epoch 40, CIFAR-10 Batch 10: Loss: 0.1629 Validation Accuracy: 0.878600 Epoch 40, CIFAR-10 Batch 11: Loss: 0.1693 Validation Accuracy: 0.875400 Epoch 40, CIFAR-10 Batch 12: Loss: 0.2215 Validation Accuracy: 0.869200 Epoch 40, CIFAR-10 Batch 13: Loss: 0.1924 Validation Accuracy: 0.869800 Epoch 40, CIFAR-10 Batch 14: Loss: 0.2280 Validation Accuracy: 0.862400 Epoch 40, CIFAR-10 Batch 15: Loss: 0.1584 Validation Accuracy: 0.878800 Epoch 40, CIFAR-10 Batch 16: Loss: 0.1722 Validation Accuracy: 0.872000 Epoch 40, CIFAR-10 Batch 17: Loss: 0.2437 Validation Accuracy: 0.875200 Epoch 40, CIFAR-10 Batch 18: Loss: 0.2018 Validation Accuracy: 0.868200 Epoch 40, CIFAR-10 Batch 19: Loss: 0.1378 Validation Accuracy: 0.876400 Epoch 40, CIFAR-10 Batch 20: Loss: 0.2963 Validation Accuracy: 0.863800 Epoch 40, CIFAR-10 Batch 21: Loss: 0.1815 Validation Accuracy: 0.882200 Epoch 40, CIFAR-10 Batch 22: Loss: 0.2278 Validation Accuracy: 0.861200 Epoch 40, CIFAR-10 Batch 23: Loss: 0.2115 Validation Accuracy: 0.870000 Epoch 40, CIFAR-10 Batch 24: Loss: 0.2111 Validation Accuracy: 0.881400 Epoch 40, CIFAR-10 Batch 25: Loss: 0.2249 Validation Accuracy: 0.870600 Epoch 40, CIFAR-10 Batch 26: Loss: 0.1759 Validation Accuracy: 0.865800 Epoch 40, CIFAR-10 Batch 27: Loss: 0.1390 Validation Accuracy: 0.877000 Epoch 40, CIFAR-10 Batch 28: Loss: 0.2441 Validation Accuracy: 0.876800 Epoch 40, CIFAR-10 Batch 29: Loss: 0.1943 Validation Accuracy: 0.873600 Epoch 40, CIFAR-10 Batch 30: Loss: 0.1640 Validation Accuracy: 0.869000 Epoch 40, CIFAR-10 Batch 31: Loss: 0.1685 Validation Accuracy: 0.866600 Epoch 40, CIFAR-10 Batch 32: Loss: 0.1550 Validation Accuracy: 0.881600 Epoch 40, CIFAR-10 Batch 33: Loss: 0.2673 Validation Accuracy: 0.860400 Epoch 40, CIFAR-10 Batch 34: Loss: 0.2929 Validation Accuracy: 0.869600 Epoch 40, CIFAR-10 Batch 35: Loss: 0.3021 Validation Accuracy: 0.877600 Epoch 40, CIFAR-10 Batch 36: Loss: 0.2667 Validation Accuracy: 0.870000 Epoch 40, CIFAR-10 Batch 37: Loss: 0.1808 Validation Accuracy: 0.875000 Epoch 40, CIFAR-10 Batch 38: Loss: 0.1612 Validation Accuracy: 0.875600 Epoch 40, CIFAR-10 Batch 39: Loss: 0.1449 Validation Accuracy: 0.875200 Epoch 40, CIFAR-10 Batch 40: Loss: 0.2675 Validation Accuracy: 0.863600 Epoch 40, CIFAR-10 Batch 41: Loss: 0.2008 Validation Accuracy: 0.860400 Epoch 40, CIFAR-10 Batch 42: Loss: 0.2889 Validation Accuracy: 0.869400 Epoch 40, CIFAR-10 Batch 43: Loss: 0.2883 Validation Accuracy: 0.866600 Epoch 40, CIFAR-10 Batch 44: Loss: 0.2490 Validation Accuracy: 0.859400 Epoch 40, CIFAR-10 Batch 45: Loss: 0.1830 Validation Accuracy: 0.880800 Epoch 40, CIFAR-10 Batch 46: Loss: 0.2769 Validation Accuracy: 0.860400 Epoch 40, CIFAR-10 Batch 47: Loss: 0.2050 Validation Accuracy: 0.873000 Epoch 40, CIFAR-10 Batch 48: Loss: 0.1745 Validation Accuracy: 0.887200 Epoch 40, CIFAR-10 Batch 49: Loss: 0.2470 Validation Accuracy: 0.870200 Epoch 40, CIFAR-10 Batch 50: Loss: 0.1679 Validation Accuracy: 0.879200 Epoch 41, CIFAR-10 Batch 1: Loss: 0.1652 Validation Accuracy: 0.882400 Epoch 41, CIFAR-10 Batch 2: Loss: 0.1659 Validation Accuracy: 0.864400 Epoch 41, CIFAR-10 Batch 3: Loss: 0.1427 Validation Accuracy: 0.882600 Epoch 41, CIFAR-10 Batch 4: Loss: 0.1396 Validation Accuracy: 0.872600 Epoch 41, CIFAR-10 Batch 5: Loss: 0.1913 Validation Accuracy: 0.875000 Epoch 41, CIFAR-10 Batch 6: Loss: 0.3160 Validation Accuracy: 0.871000 Epoch 41, CIFAR-10 Batch 7: Loss: 0.1566 Validation Accuracy: 0.860600 Epoch 41, CIFAR-10 Batch 8: Loss: 0.2377 Validation Accuracy: 0.872000 Epoch 41, CIFAR-10 Batch 9: Loss: 0.1801 Validation Accuracy: 0.877200 Epoch 41, CIFAR-10 Batch 10: Loss: 0.1409 Validation Accuracy: 0.881600 Epoch 41, CIFAR-10 Batch 11: Loss: 0.1555 Validation Accuracy: 0.871200 Epoch 41, CIFAR-10 Batch 12: Loss: 0.2297 Validation Accuracy: 0.877800 Epoch 41, CIFAR-10 Batch 13: Loss: 0.1852 Validation Accuracy: 0.881200 Epoch 41, CIFAR-10 Batch 14: Loss: 0.2219 Validation Accuracy: 0.872600 Epoch 41, CIFAR-10 Batch 15: Loss: 0.1733 Validation Accuracy: 0.864400 Epoch 41, CIFAR-10 Batch 16: Loss: 0.1693 Validation Accuracy: 0.865000 Epoch 41, CIFAR-10 Batch 17: Loss: 0.2569 Validation Accuracy: 0.872000 Epoch 41, CIFAR-10 Batch 18: Loss: 0.1641 Validation Accuracy: 0.878800 Epoch 41, CIFAR-10 Batch 19: Loss: 0.1466 Validation Accuracy: 0.864600 Epoch 41, CIFAR-10 Batch 20: Loss: 0.3099 Validation Accuracy: 0.872000 Epoch 41, CIFAR-10 Batch 21: Loss: 0.1744 Validation Accuracy: 0.871200 Epoch 41, CIFAR-10 Batch 22: Loss: 0.1912 Validation Accuracy: 0.878400 Epoch 41, CIFAR-10 Batch 23: Loss: 0.2042 Validation Accuracy: 0.876200 Epoch 41, CIFAR-10 Batch 24: Loss: 0.2032 Validation Accuracy: 0.875200 Epoch 41, CIFAR-10 Batch 25: Loss: 0.2373 Validation Accuracy: 0.854600 Epoch 41, CIFAR-10 Batch 26: Loss: 0.1980 Validation Accuracy: 0.880600 Epoch 41, CIFAR-10 Batch 27: Loss: 0.1407 Validation Accuracy: 0.876800 Epoch 41, CIFAR-10 Batch 28: Loss: 0.2427 Validation Accuracy: 0.882400 Epoch 41, CIFAR-10 Batch 29: Loss: 0.1498 Validation Accuracy: 0.877200 Epoch 41, CIFAR-10 Batch 30: Loss: 0.1429 Validation Accuracy: 0.877600 Epoch 41, CIFAR-10 Batch 31: Loss: 0.1740 Validation Accuracy: 0.881200 Epoch 41, CIFAR-10 Batch 32: Loss: 0.1581 Validation Accuracy: 0.869800 Epoch 41, CIFAR-10 Batch 33: Loss: 0.3010 Validation Accuracy: 0.868600 Epoch 41, CIFAR-10 Batch 34: Loss: 0.3150 Validation Accuracy: 0.864600 Epoch 41, CIFAR-10 Batch 35: Loss: 0.2557 Validation Accuracy: 0.874400 Epoch 41, CIFAR-10 Batch 36: Loss: 0.2420 Validation Accuracy: 0.871400 Epoch 41, CIFAR-10 Batch 37: Loss: 0.1532 Validation Accuracy: 0.876400 Epoch 41, CIFAR-10 Batch 38: Loss: 0.1445 Validation Accuracy: 0.877600 Epoch 41, CIFAR-10 Batch 39: Loss: 0.1535 Validation Accuracy: 0.876600 Epoch 41, CIFAR-10 Batch 40: Loss: 0.2664 Validation Accuracy: 0.870200 Epoch 41, CIFAR-10 Batch 41: Loss: 0.2210 Validation Accuracy: 0.873800 Epoch 41, CIFAR-10 Batch 42: Loss: 0.2024 Validation Accuracy: 0.864200 Epoch 41, CIFAR-10 Batch 43: Loss: 0.2515 Validation Accuracy: 0.879600 Epoch 41, CIFAR-10 Batch 44: Loss: 0.2507 Validation Accuracy: 0.869000 Epoch 41, CIFAR-10 Batch 45: Loss: 0.1964 Validation Accuracy: 0.869000 Epoch 41, CIFAR-10 Batch 46: Loss: 0.2495 Validation Accuracy: 0.863600 Epoch 41, CIFAR-10 Batch 47: Loss: 0.1954 Validation Accuracy: 0.875600 Epoch 41, CIFAR-10 Batch 48: Loss: 0.1748 Validation Accuracy: 0.876400 Epoch 41, CIFAR-10 Batch 49: Loss: 0.2595 Validation Accuracy: 0.887200 Epoch 41, CIFAR-10 Batch 50: Loss: 0.1694 Validation Accuracy: 0.881000 Epoch 42, CIFAR-10 Batch 1: Loss: 0.1754 Validation Accuracy: 0.867600 Epoch 42, CIFAR-10 Batch 2: Loss: 0.1837 Validation Accuracy: 0.865800 Epoch 42, CIFAR-10 Batch 3: Loss: 0.1876 Validation Accuracy: 0.874000 Epoch 42, CIFAR-10 Batch 4: Loss: 0.1671 Validation Accuracy: 0.862600 Epoch 42, CIFAR-10 Batch 5: Loss: 0.1818 Validation Accuracy: 0.876400 Epoch 42, CIFAR-10 Batch 6: Loss: 0.2784 Validation Accuracy: 0.842600 Epoch 42, CIFAR-10 Batch 7: Loss: 0.1805 Validation Accuracy: 0.868800 Epoch 42, CIFAR-10 Batch 8: Loss: 0.2596 Validation Accuracy: 0.879400 Epoch 42, CIFAR-10 Batch 9: Loss: 0.2008 Validation Accuracy: 0.881000 Epoch 42, CIFAR-10 Batch 10: Loss: 0.1566 Validation Accuracy: 0.861400 Epoch 42, CIFAR-10 Batch 11: Loss: 0.1877 Validation Accuracy: 0.877400 Epoch 42, CIFAR-10 Batch 12: Loss: 0.2060 Validation Accuracy: 0.877400 Epoch 42, CIFAR-10 Batch 13: Loss: 0.2057 Validation Accuracy: 0.872200 Epoch 42, CIFAR-10 Batch 14: Loss: 0.1958 Validation Accuracy: 0.876600 Epoch 42, CIFAR-10 Batch 15: Loss: 0.1545 Validation Accuracy: 0.871200 Epoch 42, CIFAR-10 Batch 16: Loss: 0.1777 Validation Accuracy: 0.863800 Epoch 42, CIFAR-10 Batch 17: Loss: 0.2242 Validation Accuracy: 0.866800 Epoch 42, CIFAR-10 Batch 18: Loss: 0.1893 Validation Accuracy: 0.862800 Epoch 42, CIFAR-10 Batch 19: Loss: 0.1564 Validation Accuracy: 0.878800 Epoch 42, CIFAR-10 Batch 20: Loss: 0.2813 Validation Accuracy: 0.877200 Epoch 42, CIFAR-10 Batch 21: Loss: 0.1496 Validation Accuracy: 0.874200 Epoch 42, CIFAR-10 Batch 22: Loss: 0.1851 Validation Accuracy: 0.876400 Epoch 42, CIFAR-10 Batch 23: Loss: 0.2083 Validation Accuracy: 0.868400 Epoch 42, CIFAR-10 Batch 24: Loss: 0.1789 Validation Accuracy: 0.881600 Epoch 42, CIFAR-10 Batch 25: Loss: 0.2553 Validation Accuracy: 0.871200 Epoch 42, CIFAR-10 Batch 26: Loss: 0.1814 Validation Accuracy: 0.875800 Epoch 42, CIFAR-10 Batch 27: Loss: 0.1399 Validation Accuracy: 0.877400 Epoch 42, CIFAR-10 Batch 28: Loss: 0.3144 Validation Accuracy: 0.881200 Epoch 42, CIFAR-10 Batch 29: Loss: 0.1606 Validation Accuracy: 0.881200 Epoch 42, CIFAR-10 Batch 30: Loss: 0.1556 Validation Accuracy: 0.882600 Epoch 42, CIFAR-10 Batch 31: Loss: 0.1775 Validation Accuracy: 0.876200 Epoch 42, CIFAR-10 Batch 32: Loss: 0.1426 Validation Accuracy: 0.860400 Epoch 42, CIFAR-10 Batch 33: Loss: 0.2577 Validation Accuracy: 0.880400 Epoch 42, CIFAR-10 Batch 34: Loss: 0.3132 Validation Accuracy: 0.874800 Epoch 42, CIFAR-10 Batch 35: Loss: 0.2281 Validation Accuracy: 0.872000 Epoch 42, CIFAR-10 Batch 36: Loss: 0.2495 Validation Accuracy: 0.866600 Epoch 42, CIFAR-10 Batch 37: Loss: 0.1864 Validation Accuracy: 0.871400 Epoch 42, CIFAR-10 Batch 38: Loss: 0.1500 Validation Accuracy: 0.861600 Epoch 42, CIFAR-10 Batch 39: Loss: 0.1433 Validation Accuracy: 0.876000 Epoch 42, CIFAR-10 Batch 40: Loss: 0.2245 Validation Accuracy: 0.875600 Epoch 42, CIFAR-10 Batch 41: Loss: 0.1814 Validation Accuracy: 0.882400 Epoch 42, CIFAR-10 Batch 42: Loss: 0.2173 Validation Accuracy: 0.867600 Epoch 42, CIFAR-10 Batch 43: Loss: 0.2997 Validation Accuracy: 0.876000 Epoch 42, CIFAR-10 Batch 44: Loss: 0.2393 Validation Accuracy: 0.878200 Epoch 42, CIFAR-10 Batch 45: Loss: 0.1788 Validation Accuracy: 0.882400 Epoch 42, CIFAR-10 Batch 46: Loss: 0.2473 Validation Accuracy: 0.883800 Epoch 42, CIFAR-10 Batch 47: Loss: 0.1808 Validation Accuracy: 0.881800 Epoch 42, CIFAR-10 Batch 48: Loss: 0.1618 Validation Accuracy: 0.887400 Epoch 42, CIFAR-10 Batch 49: Loss: 0.2575 Validation Accuracy: 0.880000 Epoch 42, CIFAR-10 Batch 50: Loss: 0.1775 Validation Accuracy: 0.881400 Epoch 43, CIFAR-10 Batch 1: Loss: 0.1649 Validation Accuracy: 0.881600 Epoch 43, CIFAR-10 Batch 2: Loss: 0.1551 Validation Accuracy: 0.873000 Epoch 43, CIFAR-10 Batch 3: Loss: 0.1944 Validation Accuracy: 0.881600 Epoch 43, CIFAR-10 Batch 4: Loss: 0.1408 Validation Accuracy: 0.869600 Epoch 43, CIFAR-10 Batch 5: Loss: 0.1976 Validation Accuracy: 0.874400 Epoch 43, CIFAR-10 Batch 6: Loss: 0.3583 Validation Accuracy: 0.881400 Epoch 43, CIFAR-10 Batch 7: Loss: 0.1560 Validation Accuracy: 0.866800 Epoch 43, CIFAR-10 Batch 8: Loss: 0.2361 Validation Accuracy: 0.875800 Epoch 43, CIFAR-10 Batch 9: Loss: 0.2479 Validation Accuracy: 0.872800 Epoch 43, CIFAR-10 Batch 10: Loss: 0.1323 Validation Accuracy: 0.876200 Epoch 43, CIFAR-10 Batch 11: Loss: 0.1671 Validation Accuracy: 0.874000 Epoch 43, CIFAR-10 Batch 12: Loss: 0.1950 Validation Accuracy: 0.884600 Epoch 43, CIFAR-10 Batch 13: Loss: 0.2093 Validation Accuracy: 0.879400 Epoch 43, CIFAR-10 Batch 14: Loss: 0.2047 Validation Accuracy: 0.866400 Epoch 43, CIFAR-10 Batch 15: Loss: 0.2132 Validation Accuracy: 0.871800 Epoch 43, CIFAR-10 Batch 16: Loss: 0.1834 Validation Accuracy: 0.880000 Epoch 43, CIFAR-10 Batch 17: Loss: 0.2543 Validation Accuracy: 0.876000 Epoch 43, CIFAR-10 Batch 18: Loss: 0.1412 Validation Accuracy: 0.856200 Epoch 43, CIFAR-10 Batch 19: Loss: 0.1372 Validation Accuracy: 0.877400 Epoch 43, CIFAR-10 Batch 20: Loss: 0.2553 Validation Accuracy: 0.876800 Epoch 43, CIFAR-10 Batch 21: Loss: 0.1483 Validation Accuracy: 0.872600 Epoch 43, CIFAR-10 Batch 22: Loss: 0.2041 Validation Accuracy: 0.861600 Epoch 43, CIFAR-10 Batch 23: Loss: 0.2339 Validation Accuracy: 0.869800 Epoch 43, CIFAR-10 Batch 24: Loss: 0.1865 Validation Accuracy: 0.884000 Epoch 43, CIFAR-10 Batch 25: Loss: 0.2321 Validation Accuracy: 0.866000 Epoch 43, CIFAR-10 Batch 26: Loss: 0.1737 Validation Accuracy: 0.879200 Epoch 43, CIFAR-10 Batch 27: Loss: 0.1404 Validation Accuracy: 0.878200 Epoch 43, CIFAR-10 Batch 28: Loss: 0.2888 Validation Accuracy: 0.879600 Epoch 43, CIFAR-10 Batch 29: Loss: 0.1632 Validation Accuracy: 0.871000 Epoch 43, CIFAR-10 Batch 30: Loss: 0.1355 Validation Accuracy: 0.875600 Epoch 43, CIFAR-10 Batch 31: Loss: 0.1804 Validation Accuracy: 0.878800 Epoch 43, CIFAR-10 Batch 32: Loss: 0.1503 Validation Accuracy: 0.878400 Epoch 43, CIFAR-10 Batch 33: Loss: 0.2224 Validation Accuracy: 0.875800 Epoch 43, CIFAR-10 Batch 34: Loss: 0.3021 Validation Accuracy: 0.874200 Epoch 43, CIFAR-10 Batch 35: Loss: 0.2469 Validation Accuracy: 0.866000 Epoch 43, CIFAR-10 Batch 36: Loss: 0.2425 Validation Accuracy: 0.873000 Epoch 43, CIFAR-10 Batch 37: Loss: 0.1672 Validation Accuracy: 0.881800 Epoch 43, CIFAR-10 Batch 38: Loss: 0.1343 Validation Accuracy: 0.869400 Epoch 43, CIFAR-10 Batch 39: Loss: 0.1440 Validation Accuracy: 0.870600 Epoch 43, CIFAR-10 Batch 40: Loss: 0.2213 Validation Accuracy: 0.872800 Epoch 43, CIFAR-10 Batch 41: Loss: 0.2109 Validation Accuracy: 0.873600 Epoch 43, CIFAR-10 Batch 42: Loss: 0.1805 Validation Accuracy: 0.882000 Epoch 43, CIFAR-10 Batch 43: Loss: 0.2360 Validation Accuracy: 0.877600 Epoch 43, CIFAR-10 Batch 44: Loss: 0.2225 Validation Accuracy: 0.869800 Epoch 43, CIFAR-10 Batch 45: Loss: 0.1653 Validation Accuracy: 0.863400 Epoch 43, CIFAR-10 Batch 46: Loss: 0.1947 Validation Accuracy: 0.884600 Epoch 43, CIFAR-10 Batch 47: Loss: 0.1741 Validation Accuracy: 0.880800 Epoch 43, CIFAR-10 Batch 48: Loss: 0.2265 Validation Accuracy: 0.877600 Epoch 43, CIFAR-10 Batch 49: Loss: 0.2891 Validation Accuracy: 0.885600 Epoch 43, CIFAR-10 Batch 50: Loss: 0.1958 Validation Accuracy: 0.882600 Epoch 44, CIFAR-10 Batch 1: Loss: 0.1628 Validation Accuracy: 0.872600 Epoch 44, CIFAR-10 Batch 2: Loss: 0.1682 Validation Accuracy: 0.859000 Epoch 44, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.881600 Epoch 44, CIFAR-10 Batch 4: Loss: 0.1752 Validation Accuracy: 0.881400 Epoch 44, CIFAR-10 Batch 5: Loss: 0.2025 Validation Accuracy: 0.882600 Epoch 44, CIFAR-10 Batch 6: Loss: 0.3603 Validation Accuracy: 0.879000 Epoch 44, CIFAR-10 Batch 7: Loss: 0.1741 Validation Accuracy: 0.851600 Epoch 44, CIFAR-10 Batch 8: Loss: 0.2422 Validation Accuracy: 0.890400 Epoch 44, CIFAR-10 Batch 9: Loss: 0.2133 Validation Accuracy: 0.883800 Epoch 44, CIFAR-10 Batch 10: Loss: 0.1436 Validation Accuracy: 0.868400 Epoch 44, CIFAR-10 Batch 11: Loss: 0.1582 Validation Accuracy: 0.880800 Epoch 44, CIFAR-10 Batch 12: Loss: 0.2430 Validation Accuracy: 0.872800 Epoch 44, CIFAR-10 Batch 13: Loss: 0.1985 Validation Accuracy: 0.861600 Epoch 44, CIFAR-10 Batch 14: Loss: 0.1788 Validation Accuracy: 0.859200 Epoch 44, CIFAR-10 Batch 15: Loss: 0.1696 Validation Accuracy: 0.861200 Epoch 44, CIFAR-10 Batch 16: Loss: 0.1830 Validation Accuracy: 0.857200 Epoch 44, CIFAR-10 Batch 17: Loss: 0.2308 Validation Accuracy: 0.883200 Epoch 44, CIFAR-10 Batch 18: Loss: 0.1524 Validation Accuracy: 0.864200 Epoch 44, CIFAR-10 Batch 19: Loss: 0.1565 Validation Accuracy: 0.863400 Epoch 44, CIFAR-10 Batch 20: Loss: 0.2167 Validation Accuracy: 0.872600 Epoch 44, CIFAR-10 Batch 21: Loss: 0.1437 Validation Accuracy: 0.887000 Epoch 44, CIFAR-10 Batch 22: Loss: 0.1913 Validation Accuracy: 0.873400 Epoch 44, CIFAR-10 Batch 23: Loss: 0.2215 Validation Accuracy: 0.867000 Epoch 44, CIFAR-10 Batch 24: Loss: 0.2053 Validation Accuracy: 0.893000 Epoch 44, CIFAR-10 Batch 25: Loss: 0.2462 Validation Accuracy: 0.873000 Epoch 44, CIFAR-10 Batch 26: Loss: 0.1674 Validation Accuracy: 0.873200 Epoch 44, CIFAR-10 Batch 27: Loss: 0.1338 Validation Accuracy: 0.859000 Epoch 44, CIFAR-10 Batch 28: Loss: 0.2833 Validation Accuracy: 0.871000 Epoch 44, CIFAR-10 Batch 29: Loss: 0.1888 Validation Accuracy: 0.870600 Epoch 44, CIFAR-10 Batch 30: Loss: 0.1567 Validation Accuracy: 0.883000 Epoch 44, CIFAR-10 Batch 31: Loss: 0.1745 Validation Accuracy: 0.875600 Epoch 44, CIFAR-10 Batch 32: Loss: 0.1408 Validation Accuracy: 0.881800 Epoch 44, CIFAR-10 Batch 33: Loss: 0.2677 Validation Accuracy: 0.869800 Epoch 44, CIFAR-10 Batch 34: Loss: 0.3393 Validation Accuracy: 0.873600 Epoch 44, CIFAR-10 Batch 35: Loss: 0.2648 Validation Accuracy: 0.873600 Epoch 44, CIFAR-10 Batch 36: Loss: 0.2757 Validation Accuracy: 0.864200 Epoch 44, CIFAR-10 Batch 37: Loss: 0.1698 Validation Accuracy: 0.870200 Epoch 44, CIFAR-10 Batch 38: Loss: 0.1509 Validation Accuracy: 0.881000 Epoch 44, CIFAR-10 Batch 39: Loss: 0.1323 Validation Accuracy: 0.861400 Epoch 44, CIFAR-10 Batch 40: Loss: 0.2151 Validation Accuracy: 0.850800 Epoch 44, CIFAR-10 Batch 41: Loss: 0.1846 Validation Accuracy: 0.868400 Epoch 44, CIFAR-10 Batch 42: Loss: 0.1903 Validation Accuracy: 0.872800 Epoch 44, CIFAR-10 Batch 43: Loss: 0.2368 Validation Accuracy: 0.876200 Epoch 44, CIFAR-10 Batch 44: Loss: 0.1922 Validation Accuracy: 0.867000 Epoch 44, CIFAR-10 Batch 45: Loss: 0.1497 Validation Accuracy: 0.876600 Epoch 44, CIFAR-10 Batch 46: Loss: 0.1928 Validation Accuracy: 0.863000 Epoch 44, CIFAR-10 Batch 47: Loss: 0.2053 Validation Accuracy: 0.880000 Epoch 44, CIFAR-10 Batch 48: Loss: 0.2001 Validation Accuracy: 0.884200 Epoch 44, CIFAR-10 Batch 49: Loss: 0.2777 Validation Accuracy: 0.868000 Epoch 44, CIFAR-10 Batch 50: Loss: 0.1665 Validation Accuracy: 0.873200 Epoch 45, CIFAR-10 Batch 1: Loss: 0.1597 Validation Accuracy: 0.873000 Epoch 45, CIFAR-10 Batch 2: Loss: 0.2262 Validation Accuracy: 0.875000 Epoch 45, CIFAR-10 Batch 3: Loss: 0.1468 Validation Accuracy: 0.887800 Epoch 45, CIFAR-10 Batch 4: Loss: 0.1585 Validation Accuracy: 0.872400 Epoch 45, CIFAR-10 Batch 5: Loss: 0.1860 Validation Accuracy: 0.873400 Epoch 45, CIFAR-10 Batch 6: Loss: 0.3102 Validation Accuracy: 0.871400 Epoch 45, CIFAR-10 Batch 7: Loss: 0.1720 Validation Accuracy: 0.871600 Epoch 45, CIFAR-10 Batch 8: Loss: 0.2303 Validation Accuracy: 0.887600 Epoch 45, CIFAR-10 Batch 9: Loss: 0.1862 Validation Accuracy: 0.873600 Epoch 45, CIFAR-10 Batch 10: Loss: 0.1303 Validation Accuracy: 0.855200 Epoch 45, CIFAR-10 Batch 11: Loss: 0.1762 Validation Accuracy: 0.884800 Epoch 45, CIFAR-10 Batch 12: Loss: 0.2254 Validation Accuracy: 0.880600 Epoch 45, CIFAR-10 Batch 13: Loss: 0.2506 Validation Accuracy: 0.879800 Epoch 45, CIFAR-10 Batch 14: Loss: 0.1802 Validation Accuracy: 0.866200 Epoch 45, CIFAR-10 Batch 15: Loss: 0.1780 Validation Accuracy: 0.868400 Epoch 45, CIFAR-10 Batch 16: Loss: 0.1606 Validation Accuracy: 0.865800 Epoch 45, CIFAR-10 Batch 17: Loss: 0.2153 Validation Accuracy: 0.866600 Epoch 45, CIFAR-10 Batch 18: Loss: 0.1676 Validation Accuracy: 0.877400 Epoch 45, CIFAR-10 Batch 19: Loss: 0.1523 Validation Accuracy: 0.875000 Epoch 45, CIFAR-10 Batch 20: Loss: 0.2738 Validation Accuracy: 0.848000 Epoch 45, CIFAR-10 Batch 21: Loss: 0.1425 Validation Accuracy: 0.874600 Epoch 45, CIFAR-10 Batch 22: Loss: 0.1863 Validation Accuracy: 0.882600 Epoch 45, CIFAR-10 Batch 23: Loss: 0.1874 Validation Accuracy: 0.882000 Epoch 45, CIFAR-10 Batch 24: Loss: 0.2520 Validation Accuracy: 0.881400 Epoch 45, CIFAR-10 Batch 25: Loss: 0.2350 Validation Accuracy: 0.868000 Epoch 45, CIFAR-10 Batch 26: Loss: 0.1656 Validation Accuracy: 0.879600 Epoch 45, CIFAR-10 Batch 27: Loss: 0.1411 Validation Accuracy: 0.875600 Epoch 45, CIFAR-10 Batch 28: Loss: 0.3250 Validation Accuracy: 0.871400 Epoch 45, CIFAR-10 Batch 29: Loss: 0.2024 Validation Accuracy: 0.877800 Epoch 45, CIFAR-10 Batch 30: Loss: 0.1383 Validation Accuracy: 0.864400 Epoch 45, CIFAR-10 Batch 31: Loss: 0.1663 Validation Accuracy: 0.871200 Epoch 45, CIFAR-10 Batch 32: Loss: 0.1393 Validation Accuracy: 0.866800 Epoch 45, CIFAR-10 Batch 33: Loss: 0.2569 Validation Accuracy: 0.870600 Epoch 45, CIFAR-10 Batch 34: Loss: 0.3264 Validation Accuracy: 0.874200 Epoch 45, CIFAR-10 Batch 35: Loss: 0.2785 Validation Accuracy: 0.880400 Epoch 45, CIFAR-10 Batch 36: Loss: 0.2419 Validation Accuracy: 0.875200 Epoch 45, CIFAR-10 Batch 37: Loss: 0.1608 Validation Accuracy: 0.874200 Epoch 45, CIFAR-10 Batch 38: Loss: 0.1409 Validation Accuracy: 0.867800 Epoch 45, CIFAR-10 Batch 39: Loss: 0.1378 Validation Accuracy: 0.878600 Epoch 45, CIFAR-10 Batch 40: Loss: 0.2115 Validation Accuracy: 0.856600 Epoch 45, CIFAR-10 Batch 41: Loss: 0.1901 Validation Accuracy: 0.862200 Epoch 45, CIFAR-10 Batch 42: Loss: 0.1860 Validation Accuracy: 0.876800 Epoch 45, CIFAR-10 Batch 43: Loss: 0.2746 Validation Accuracy: 0.876200 Epoch 45, CIFAR-10 Batch 44: Loss: 0.2136 Validation Accuracy: 0.872600 Epoch 45, CIFAR-10 Batch 45: Loss: 0.1679 Validation Accuracy: 0.881400 Epoch 45, CIFAR-10 Batch 46: Loss: 0.2827 Validation Accuracy: 0.869000 Epoch 45, CIFAR-10 Batch 47: Loss: 0.1970 Validation Accuracy: 0.870000 Epoch 45, CIFAR-10 Batch 48: Loss: 0.1700 Validation Accuracy: 0.863600 Epoch 45, CIFAR-10 Batch 49: Loss: 0.2261 Validation Accuracy: 0.874400 Epoch 45, CIFAR-10 Batch 50: Loss: 0.1791 Validation Accuracy: 0.881600 Epoch 46, CIFAR-10 Batch 1: Loss: 0.1631 Validation Accuracy: 0.876600 Epoch 46, CIFAR-10 Batch 2: Loss: 0.2182 Validation Accuracy: 0.871200 Epoch 46, CIFAR-10 Batch 3: Loss: 0.1431 Validation Accuracy: 0.877400 Epoch 46, CIFAR-10 Batch 4: Loss: 0.1554 Validation Accuracy: 0.881200 Epoch 46, CIFAR-10 Batch 5: Loss: 0.1971 Validation Accuracy: 0.874800 Epoch 46, CIFAR-10 Batch 6: Loss: 0.3014 Validation Accuracy: 0.878800 Epoch 46, CIFAR-10 Batch 7: Loss: 0.1464 Validation Accuracy: 0.874000 Epoch 46, CIFAR-10 Batch 8: Loss: 0.2827 Validation Accuracy: 0.871400 Epoch 46, CIFAR-10 Batch 9: Loss: 0.1926 Validation Accuracy: 0.876000 Epoch 46, CIFAR-10 Batch 10: Loss: 0.1350 Validation Accuracy: 0.876800 Epoch 46, CIFAR-10 Batch 11: Loss: 0.1614 Validation Accuracy: 0.882400 Epoch 46, CIFAR-10 Batch 12: Loss: 0.2352 Validation Accuracy: 0.881600 Epoch 46, CIFAR-10 Batch 13: Loss: 0.1844 Validation Accuracy: 0.876400 Epoch 46, CIFAR-10 Batch 14: Loss: 0.2133 Validation Accuracy: 0.867600 Epoch 46, CIFAR-10 Batch 15: Loss: 0.1606 Validation Accuracy: 0.873600 Epoch 46, CIFAR-10 Batch 16: Loss: 0.1666 Validation Accuracy: 0.880000 Epoch 46, CIFAR-10 Batch 17: Loss: 0.2015 Validation Accuracy: 0.881800 Epoch 46, CIFAR-10 Batch 18: Loss: 0.1536 Validation Accuracy: 0.872000 Epoch 46, CIFAR-10 Batch 19: Loss: 0.1424 Validation Accuracy: 0.871400 Epoch 46, CIFAR-10 Batch 20: Loss: 0.2553 Validation Accuracy: 0.880000 Epoch 46, CIFAR-10 Batch 21: Loss: 0.1406 Validation Accuracy: 0.884800 Epoch 46, CIFAR-10 Batch 22: Loss: 0.1770 Validation Accuracy: 0.882000 Epoch 46, CIFAR-10 Batch 23: Loss: 0.1923 Validation Accuracy: 0.878600 Epoch 46, CIFAR-10 Batch 24: Loss: 0.1993 Validation Accuracy: 0.891000 Epoch 46, CIFAR-10 Batch 25: Loss: 0.1859 Validation Accuracy: 0.886200 Epoch 46, CIFAR-10 Batch 26: Loss: 0.1688 Validation Accuracy: 0.883600 Epoch 46, CIFAR-10 Batch 27: Loss: 0.1382 Validation Accuracy: 0.843200 Epoch 46, CIFAR-10 Batch 28: Loss: 0.2793 Validation Accuracy: 0.882200 Epoch 46, CIFAR-10 Batch 29: Loss: 0.1695 Validation Accuracy: 0.881800 Epoch 46, CIFAR-10 Batch 30: Loss: 0.1425 Validation Accuracy: 0.867400 Epoch 46, CIFAR-10 Batch 31: Loss: 0.1746 Validation Accuracy: 0.882000 Epoch 46, CIFAR-10 Batch 32: Loss: 0.1490 Validation Accuracy: 0.877000 Epoch 46, CIFAR-10 Batch 33: Loss: 0.2585 Validation Accuracy: 0.870000 Epoch 46, CIFAR-10 Batch 34: Loss: 0.2971 Validation Accuracy: 0.877400 Epoch 46, CIFAR-10 Batch 35: Loss: 0.2629 Validation Accuracy: 0.880800 Epoch 46, CIFAR-10 Batch 36: Loss: 0.2787 Validation Accuracy: 0.878200 Epoch 46, CIFAR-10 Batch 37: Loss: 0.1506 Validation Accuracy: 0.883800 Epoch 46, CIFAR-10 Batch 38: Loss: 0.1476 Validation Accuracy: 0.873000 Epoch 46, CIFAR-10 Batch 39: Loss: 0.1471 Validation Accuracy: 0.876000 Epoch 46, CIFAR-10 Batch 40: Loss: 0.2062 Validation Accuracy: 0.847200 Epoch 46, CIFAR-10 Batch 41: Loss: 0.2246 Validation Accuracy: 0.865800 Epoch 46, CIFAR-10 Batch 42: Loss: 0.1899 Validation Accuracy: 0.875000 Epoch 46, CIFAR-10 Batch 43: Loss: 0.3063 Validation Accuracy: 0.878400 Epoch 46, CIFAR-10 Batch 44: Loss: 0.2058 Validation Accuracy: 0.861200 Epoch 46, CIFAR-10 Batch 45: Loss: 0.2113 Validation Accuracy: 0.879800 Epoch 46, CIFAR-10 Batch 46: Loss: 0.1768 Validation Accuracy: 0.879400 Epoch 46, CIFAR-10 Batch 47: Loss: 0.1675 Validation Accuracy: 0.886000 Epoch 46, CIFAR-10 Batch 48: Loss: 0.1828 Validation Accuracy: 0.873400 Epoch 46, CIFAR-10 Batch 49: Loss: 0.2448 Validation Accuracy: 0.875400 Epoch 46, CIFAR-10 Batch 50: Loss: 0.1749 Validation Accuracy: 0.868400 Epoch 47, CIFAR-10 Batch 1: Loss: 0.1582 Validation Accuracy: 0.878000 Epoch 47, CIFAR-10 Batch 2: Loss: 0.2242 Validation Accuracy: 0.872400 Epoch 47, CIFAR-10 Batch 3: Loss: 0.1453 Validation Accuracy: 0.882400 Epoch 47, CIFAR-10 Batch 4: Loss: 0.1589 Validation Accuracy: 0.873000 Epoch 47, CIFAR-10 Batch 5: Loss: 0.1676 Validation Accuracy: 0.879400 Epoch 47, CIFAR-10 Batch 6: Loss: 0.3683 Validation Accuracy: 0.870200 Epoch 47, CIFAR-10 Batch 7: Loss: 0.1541 Validation Accuracy: 0.875200 Epoch 47, CIFAR-10 Batch 8: Loss: 0.2057 Validation Accuracy: 0.876800 Epoch 47, CIFAR-10 Batch 9: Loss: 0.1656 Validation Accuracy: 0.880600 Epoch 47, CIFAR-10 Batch 10: Loss: 0.1423 Validation Accuracy: 0.878800 Epoch 47, CIFAR-10 Batch 11: Loss: 0.1714 Validation Accuracy: 0.875000 Epoch 47, CIFAR-10 Batch 12: Loss: 0.1935 Validation Accuracy: 0.878800 Epoch 47, CIFAR-10 Batch 13: Loss: 0.2005 Validation Accuracy: 0.880600 Epoch 47, CIFAR-10 Batch 14: Loss: 0.1734 Validation Accuracy: 0.871600 Epoch 47, CIFAR-10 Batch 15: Loss: 0.1690 Validation Accuracy: 0.872200 Epoch 47, CIFAR-10 Batch 16: Loss: 0.2243 Validation Accuracy: 0.867000 Epoch 47, CIFAR-10 Batch 17: Loss: 0.2009 Validation Accuracy: 0.888800 Epoch 47, CIFAR-10 Batch 18: Loss: 0.1430 Validation Accuracy: 0.868600 Epoch 47, CIFAR-10 Batch 19: Loss: 0.1589 Validation Accuracy: 0.882600 Epoch 47, CIFAR-10 Batch 20: Loss: 0.2537 Validation Accuracy: 0.867000 Epoch 47, CIFAR-10 Batch 21: Loss: 0.1460 Validation Accuracy: 0.884400 Epoch 47, CIFAR-10 Batch 22: Loss: 0.1773 Validation Accuracy: 0.879200 Epoch 47, CIFAR-10 Batch 23: Loss: 0.1731 Validation Accuracy: 0.864200 Epoch 47, CIFAR-10 Batch 24: Loss: 0.2333 Validation Accuracy: 0.884800 Epoch 47, CIFAR-10 Batch 25: Loss: 0.2276 Validation Accuracy: 0.875800 Epoch 47, CIFAR-10 Batch 26: Loss: 0.1832 Validation Accuracy: 0.883400 Epoch 47, CIFAR-10 Batch 27: Loss: 0.1348 Validation Accuracy: 0.870200 Epoch 47, CIFAR-10 Batch 28: Loss: 0.2398 Validation Accuracy: 0.882200 Epoch 47, CIFAR-10 Batch 29: Loss: 0.1576 Validation Accuracy: 0.876200 Epoch 47, CIFAR-10 Batch 30: Loss: 0.1584 Validation Accuracy: 0.878800 Epoch 47, CIFAR-10 Batch 31: Loss: 0.1791 Validation Accuracy: 0.865600 Epoch 47, CIFAR-10 Batch 32: Loss: 0.1366 Validation Accuracy: 0.870000 Epoch 47, CIFAR-10 Batch 33: Loss: 0.2554 Validation Accuracy: 0.875200 Epoch 47, CIFAR-10 Batch 34: Loss: 0.3064 Validation Accuracy: 0.864400 Epoch 47, CIFAR-10 Batch 35: Loss: 0.2571 Validation Accuracy: 0.875200 Epoch 47, CIFAR-10 Batch 36: Loss: 0.2896 Validation Accuracy: 0.870400 Epoch 47, CIFAR-10 Batch 37: Loss: 0.1437 Validation Accuracy: 0.879000 Epoch 47, CIFAR-10 Batch 38: Loss: 0.1445 Validation Accuracy: 0.876000 Epoch 47, CIFAR-10 Batch 39: Loss: 0.1523 Validation Accuracy: 0.876000 Epoch 47, CIFAR-10 Batch 40: Loss: 0.2209 Validation Accuracy: 0.876000 Epoch 47, CIFAR-10 Batch 41: Loss: 0.2036 Validation Accuracy: 0.881400 Epoch 47, CIFAR-10 Batch 42: Loss: 0.2090 Validation Accuracy: 0.874600 Epoch 47, CIFAR-10 Batch 43: Loss: 0.2856 Validation Accuracy: 0.884000 Epoch 47, CIFAR-10 Batch 44: Loss: 0.1929 Validation Accuracy: 0.851200 Epoch 47, CIFAR-10 Batch 45: Loss: 0.1572 Validation Accuracy: 0.876200 Epoch 47, CIFAR-10 Batch 46: Loss: 0.2156 Validation Accuracy: 0.868800 Epoch 47, CIFAR-10 Batch 47: Loss: 0.1726 Validation Accuracy: 0.886600 Epoch 47, CIFAR-10 Batch 48: Loss: 0.1833 Validation Accuracy: 0.866000 Epoch 47, CIFAR-10 Batch 49: Loss: 0.2235 Validation Accuracy: 0.880600 Epoch 47, CIFAR-10 Batch 50: Loss: 0.1748 Validation Accuracy: 0.880400 Epoch 48, CIFAR-10 Batch 1: Loss: 0.1471 Validation Accuracy: 0.876000 Epoch 48, CIFAR-10 Batch 2: Loss: 0.1708 Validation Accuracy: 0.881200 Epoch 48, CIFAR-10 Batch 3: Loss: 0.1588 Validation Accuracy: 0.885600 Epoch 48, CIFAR-10 Batch 4: Loss: 0.1633 Validation Accuracy: 0.876000 Epoch 48, CIFAR-10 Batch 5: Loss: 0.1919 Validation Accuracy: 0.871600 Epoch 48, CIFAR-10 Batch 6: Loss: 0.2665 Validation Accuracy: 0.889600 Epoch 48, CIFAR-10 Batch 7: Loss: 0.1458 Validation Accuracy: 0.875400 Epoch 48, CIFAR-10 Batch 8: Loss: 0.2074 Validation Accuracy: 0.883600 Epoch 48, CIFAR-10 Batch 9: Loss: 0.1939 Validation Accuracy: 0.884200 Epoch 48, CIFAR-10 Batch 10: Loss: 0.1340 Validation Accuracy: 0.878800 Epoch 48, CIFAR-10 Batch 11: Loss: 0.1768 Validation Accuracy: 0.863800 Epoch 48, CIFAR-10 Batch 12: Loss: 0.1954 Validation Accuracy: 0.869000 Epoch 48, CIFAR-10 Batch 13: Loss: 0.2228 Validation Accuracy: 0.884400 Epoch 48, CIFAR-10 Batch 14: Loss: 0.1955 Validation Accuracy: 0.868800 Epoch 48, CIFAR-10 Batch 15: Loss: 0.1604 Validation Accuracy: 0.886400 Epoch 48, CIFAR-10 Batch 16: Loss: 0.1753 Validation Accuracy: 0.867600 Epoch 48, CIFAR-10 Batch 17: Loss: 0.2208 Validation Accuracy: 0.882000 Epoch 48, CIFAR-10 Batch 18: Loss: 0.1930 Validation Accuracy: 0.866000 Epoch 48, CIFAR-10 Batch 19: Loss: 0.1407 Validation Accuracy: 0.890200 Epoch 48, CIFAR-10 Batch 20: Loss: 0.2437 Validation Accuracy: 0.874600 Epoch 48, CIFAR-10 Batch 21: Loss: 0.1999 Validation Accuracy: 0.866800 Epoch 48, CIFAR-10 Batch 22: Loss: 0.1956 Validation Accuracy: 0.887000 Epoch 48, CIFAR-10 Batch 23: Loss: 0.1864 Validation Accuracy: 0.874400 Epoch 48, CIFAR-10 Batch 24: Loss: 0.2011 Validation Accuracy: 0.880800 Epoch 48, CIFAR-10 Batch 25: Loss: 0.2606 Validation Accuracy: 0.870600 Epoch 48, CIFAR-10 Batch 26: Loss: 0.1818 Validation Accuracy: 0.882400 Epoch 48, CIFAR-10 Batch 27: Loss: 0.1319 Validation Accuracy: 0.869600 Epoch 48, CIFAR-10 Batch 28: Loss: 0.2599 Validation Accuracy: 0.881200 Epoch 48, CIFAR-10 Batch 29: Loss: 0.1698 Validation Accuracy: 0.873600 Epoch 48, CIFAR-10 Batch 30: Loss: 0.1440 Validation Accuracy: 0.866400 Epoch 48, CIFAR-10 Batch 31: Loss: 0.1859 Validation Accuracy: 0.878400 Epoch 48, CIFAR-10 Batch 32: Loss: 0.1487 Validation Accuracy: 0.871000 Epoch 48, CIFAR-10 Batch 33: Loss: 0.2474 Validation Accuracy: 0.874400 Epoch 48, CIFAR-10 Batch 34: Loss: 0.2698 Validation Accuracy: 0.851400 Epoch 48, CIFAR-10 Batch 35: Loss: 0.2387 Validation Accuracy: 0.881600 Epoch 48, CIFAR-10 Batch 36: Loss: 0.2635 Validation Accuracy: 0.880400 Epoch 48, CIFAR-10 Batch 37: Loss: 0.1692 Validation Accuracy: 0.869600 Epoch 48, CIFAR-10 Batch 38: Loss: 0.1594 Validation Accuracy: 0.875000 Epoch 48, CIFAR-10 Batch 39: Loss: 0.1804 Validation Accuracy: 0.878000 Epoch 48, CIFAR-10 Batch 40: Loss: 0.1966 Validation Accuracy: 0.869800 Epoch 48, CIFAR-10 Batch 41: Loss: 0.2149 Validation Accuracy: 0.875800 Epoch 48, CIFAR-10 Batch 42: Loss: 0.1770 Validation Accuracy: 0.881400 Epoch 48, CIFAR-10 Batch 43: Loss: 0.3016 Validation Accuracy: 0.867800 Epoch 48, CIFAR-10 Batch 44: Loss: 0.1778 Validation Accuracy: 0.866400 Epoch 48, CIFAR-10 Batch 45: Loss: 0.1569 Validation Accuracy: 0.881400 Epoch 48, CIFAR-10 Batch 46: Loss: 0.1808 Validation Accuracy: 0.877000 Epoch 48, CIFAR-10 Batch 47: Loss: 0.1735 Validation Accuracy: 0.880200 Epoch 48, CIFAR-10 Batch 48: Loss: 0.2121 Validation Accuracy: 0.882200 Epoch 48, CIFAR-10 Batch 49: Loss: 0.2156 Validation Accuracy: 0.880000 Epoch 48, CIFAR-10 Batch 50: Loss: 0.1874 Validation Accuracy: 0.885000 Epoch 49, CIFAR-10 Batch 1: Loss: 0.1762 Validation Accuracy: 0.870800 Epoch 49, CIFAR-10 Batch 2: Loss: 0.1971 Validation Accuracy: 0.884200 Epoch 49, CIFAR-10 Batch 3: Loss: 0.1602 Validation Accuracy: 0.873200 Epoch 49, CIFAR-10 Batch 4: Loss: 0.1468 Validation Accuracy: 0.854400 Epoch 49, CIFAR-10 Batch 5: Loss: 0.1883 Validation Accuracy: 0.873200 Epoch 49, CIFAR-10 Batch 6: Loss: 0.2798 Validation Accuracy: 0.876400 Epoch 49, CIFAR-10 Batch 7: Loss: 0.1436 Validation Accuracy: 0.878600 Epoch 49, CIFAR-10 Batch 8: Loss: 0.2418 Validation Accuracy: 0.878000 Epoch 49, CIFAR-10 Batch 9: Loss: 0.1587 Validation Accuracy: 0.873600 Epoch 49, CIFAR-10 Batch 10: Loss: 0.1690 Validation Accuracy: 0.882600 Epoch 49, CIFAR-10 Batch 11: Loss: 0.2019 Validation Accuracy: 0.886000 Epoch 49, CIFAR-10 Batch 12: Loss: 0.1669 Validation Accuracy: 0.880400 Epoch 49, CIFAR-10 Batch 13: Loss: 0.1819 Validation Accuracy: 0.871800 Epoch 49, CIFAR-10 Batch 14: Loss: 0.2135 Validation Accuracy: 0.847800 Epoch 49, CIFAR-10 Batch 15: Loss: 0.1874 Validation Accuracy: 0.866400 Epoch 49, CIFAR-10 Batch 16: Loss: 0.1691 Validation Accuracy: 0.876800 Epoch 49, CIFAR-10 Batch 17: Loss: 0.2379 Validation Accuracy: 0.877400 Epoch 49, CIFAR-10 Batch 18: Loss: 0.1794 Validation Accuracy: 0.871000 Epoch 49, CIFAR-10 Batch 19: Loss: 0.1421 Validation Accuracy: 0.878600 Epoch 49, CIFAR-10 Batch 20: Loss: 0.2695 Validation Accuracy: 0.869600 Epoch 49, CIFAR-10 Batch 21: Loss: 0.1460 Validation Accuracy: 0.876600 Epoch 49, CIFAR-10 Batch 22: Loss: 0.1826 Validation Accuracy: 0.876800 Epoch 49, CIFAR-10 Batch 23: Loss: 0.1630 Validation Accuracy: 0.878800 Epoch 49, CIFAR-10 Batch 24: Loss: 0.2185 Validation Accuracy: 0.883400 Epoch 49, CIFAR-10 Batch 25: Loss: 0.2297 Validation Accuracy: 0.878600 Epoch 49, CIFAR-10 Batch 26: Loss: 0.1547 Validation Accuracy: 0.889200 Epoch 49, CIFAR-10 Batch 27: Loss: 0.1347 Validation Accuracy: 0.874600 Epoch 49, CIFAR-10 Batch 28: Loss: 0.2701 Validation Accuracy: 0.882400 Epoch 49, CIFAR-10 Batch 29: Loss: 0.1500 Validation Accuracy: 0.869000 Epoch 49, CIFAR-10 Batch 30: Loss: 0.1450 Validation Accuracy: 0.878800 Epoch 49, CIFAR-10 Batch 31: Loss: 0.1682 Validation Accuracy: 0.880400 Epoch 49, CIFAR-10 Batch 32: Loss: 0.1765 Validation Accuracy: 0.880200 Epoch 49, CIFAR-10 Batch 33: Loss: 0.2510 Validation Accuracy: 0.867600 Epoch 49, CIFAR-10 Batch 34: Loss: 0.2919 Validation Accuracy: 0.856600 Epoch 49, CIFAR-10 Batch 35: Loss: 0.2661 Validation Accuracy: 0.877400 Epoch 49, CIFAR-10 Batch 36: Loss: 0.2587 Validation Accuracy: 0.871200 Epoch 49, CIFAR-10 Batch 37: Loss: 0.1419 Validation Accuracy: 0.879600 Epoch 49, CIFAR-10 Batch 38: Loss: 0.1498 Validation Accuracy: 0.877400 Epoch 49, CIFAR-10 Batch 39: Loss: 0.1448 Validation Accuracy: 0.886400 Epoch 49, CIFAR-10 Batch 40: Loss: 0.1797 Validation Accuracy: 0.854600 Epoch 49, CIFAR-10 Batch 41: Loss: 0.2223 Validation Accuracy: 0.878200 Epoch 49, CIFAR-10 Batch 42: Loss: 0.1942 Validation Accuracy: 0.874000 Epoch 49, CIFAR-10 Batch 43: Loss: 0.2675 Validation Accuracy: 0.883200 Epoch 49, CIFAR-10 Batch 44: Loss: 0.2030 Validation Accuracy: 0.868000 Epoch 49, CIFAR-10 Batch 45: Loss: 0.1611 Validation Accuracy: 0.872400 Epoch 49, CIFAR-10 Batch 46: Loss: 0.2037 Validation Accuracy: 0.872200 Epoch 49, CIFAR-10 Batch 47: Loss: 0.1686 Validation Accuracy: 0.878800 Epoch 49, CIFAR-10 Batch 48: Loss: 0.1740 Validation Accuracy: 0.870000 Epoch 49, CIFAR-10 Batch 49: Loss: 0.2151 Validation Accuracy: 0.883000 Epoch 49, CIFAR-10 Batch 50: Loss: 0.1920 Validation Accuracy: 0.875000 Epoch 50, CIFAR-10 Batch 1: Loss: 0.1744 Validation Accuracy: 0.877600 Epoch 50, CIFAR-10 Batch 2: Loss: 0.1944 Validation Accuracy: 0.875600 Epoch 50, CIFAR-10 Batch 3: Loss: 0.1504 Validation Accuracy: 0.875600 Epoch 50, CIFAR-10 Batch 4: Loss: 0.1623 Validation Accuracy: 0.874600 Epoch 50, CIFAR-10 Batch 5: Loss: 0.1864 Validation Accuracy: 0.882200 Epoch 50, CIFAR-10 Batch 6: Loss: 0.2341 Validation Accuracy: 0.884200 Epoch 50, CIFAR-10 Batch 7: Loss: 0.1614 Validation Accuracy: 0.884200 Epoch 50, CIFAR-10 Batch 8: Loss: 0.1861 Validation Accuracy: 0.879000 Epoch 50, CIFAR-10 Batch 9: Loss: 0.2039 Validation Accuracy: 0.877000 Epoch 50, CIFAR-10 Batch 10: Loss: 0.1376 Validation Accuracy: 0.884600 Epoch 50, CIFAR-10 Batch 11: Loss: 0.2001 Validation Accuracy: 0.883600 Epoch 50, CIFAR-10 Batch 12: Loss: 0.1646 Validation Accuracy: 0.869600 Epoch 50, CIFAR-10 Batch 13: Loss: 0.2128 Validation Accuracy: 0.876000 Epoch 50, CIFAR-10 Batch 14: Loss: 0.2096 Validation Accuracy: 0.846400 Epoch 50, CIFAR-10 Batch 15: Loss: 0.1768 Validation Accuracy: 0.877200 Epoch 50, CIFAR-10 Batch 16: Loss: 0.1738 Validation Accuracy: 0.876800 Epoch 50, CIFAR-10 Batch 17: Loss: 0.2789 Validation Accuracy: 0.879800 Epoch 50, CIFAR-10 Batch 18: Loss: 0.1512 Validation Accuracy: 0.868000 Epoch 50, CIFAR-10 Batch 19: Loss: 0.1681 Validation Accuracy: 0.880800 Epoch 50, CIFAR-10 Batch 20: Loss: 0.2507 Validation Accuracy: 0.882200 Epoch 50, CIFAR-10 Batch 21: Loss: 0.1915 Validation Accuracy: 0.854000 Epoch 50, CIFAR-10 Batch 22: Loss: 0.2031 Validation Accuracy: 0.888400 Epoch 50, CIFAR-10 Batch 23: Loss: 0.1848 Validation Accuracy: 0.876000 Epoch 50, CIFAR-10 Batch 24: Loss: 0.2121 Validation Accuracy: 0.868400 Epoch 50, CIFAR-10 Batch 25: Loss: 0.2294 Validation Accuracy: 0.867400 Epoch 50, CIFAR-10 Batch 26: Loss: 0.1636 Validation Accuracy: 0.882800 Epoch 50, CIFAR-10 Batch 27: Loss: 0.1449 Validation Accuracy: 0.866600 Epoch 50, CIFAR-10 Batch 28: Loss: 0.2655 Validation Accuracy: 0.877400 Epoch 50, CIFAR-10 Batch 29: Loss: 0.1852 Validation Accuracy: 0.874600 Epoch 50, CIFAR-10 Batch 30: Loss: 0.1378 Validation Accuracy: 0.878000 Epoch 50, CIFAR-10 Batch 31: Loss: 0.1472 Validation Accuracy: 0.870400 Epoch 50, CIFAR-10 Batch 32: Loss: 0.1790 Validation Accuracy: 0.880800 Epoch 50, CIFAR-10 Batch 33: Loss: 0.2140 Validation Accuracy: 0.880600 Epoch 50, CIFAR-10 Batch 34: Loss: 0.3078 Validation Accuracy: 0.878800 Epoch 50, CIFAR-10 Batch 35: Loss: 0.2130 Validation Accuracy: 0.889200 Epoch 50, CIFAR-10 Batch 36: Loss: 0.2828 Validation Accuracy: 0.861000 Epoch 50, CIFAR-10 Batch 37: Loss: 0.1495 Validation Accuracy: 0.865000 Epoch 50, CIFAR-10 Batch 38: Loss: 0.1455 Validation Accuracy: 0.877800 Epoch 50, CIFAR-10 Batch 39: Loss: 0.1492 Validation Accuracy: 0.879600 Epoch 50, CIFAR-10 Batch 40: Loss: 0.2172 Validation Accuracy: 0.867200 Epoch 50, CIFAR-10 Batch 41: Loss: 0.1643 Validation Accuracy: 0.871800 Epoch 50, CIFAR-10 Batch 42: Loss: 0.1802 Validation Accuracy: 0.886800 Epoch 50, CIFAR-10 Batch 43: Loss: 0.2983 Validation Accuracy: 0.874200 Epoch 50, CIFAR-10 Batch 44: Loss: 0.1787 Validation Accuracy: 0.873000 Epoch 50, CIFAR-10 Batch 45: Loss: 0.1606 Validation Accuracy: 0.881200 Epoch 50, CIFAR-10 Batch 46: Loss: 0.2448 Validation Accuracy: 0.879200 Epoch 50, CIFAR-10 Batch 47: Loss: 0.1550 Validation Accuracy: 0.887800 Epoch 50, CIFAR-10 Batch 48: Loss: 0.1861 Validation Accuracy: 0.881000 Epoch 50, CIFAR-10 Batch 49: Loss: 0.2048 Validation Accuracy: 0.875600 Epoch 50, CIFAR-10 Batch 50: Loss: 0.1825 Validation Accuracy: 0.870600 Epoch 51, CIFAR-10 Batch 1: Loss: 0.1620 Validation Accuracy: 0.876400 Epoch 51, CIFAR-10 Batch 2: Loss: 0.1835 Validation Accuracy: 0.881600 Epoch 51, CIFAR-10 Batch 3: Loss: 0.1462 Validation Accuracy: 0.875200 Epoch 51, CIFAR-10 Batch 4: Loss: 0.1731 Validation Accuracy: 0.883800 Epoch 51, CIFAR-10 Batch 5: Loss: 0.2115 Validation Accuracy: 0.887000 Epoch 51, CIFAR-10 Batch 6: Loss: 0.2906 Validation Accuracy: 0.879400 Epoch 51, CIFAR-10 Batch 7: Loss: 0.1480 Validation Accuracy: 0.863200 Epoch 51, CIFAR-10 Batch 8: Loss: 0.2736 Validation Accuracy: 0.879200 Epoch 51, CIFAR-10 Batch 9: Loss: 0.1917 Validation Accuracy: 0.877000 Epoch 51, CIFAR-10 Batch 10: Loss: 0.1303 Validation Accuracy: 0.886200 Epoch 51, CIFAR-10 Batch 11: Loss: 0.2215 Validation Accuracy: 0.873600 Epoch 51, CIFAR-10 Batch 12: Loss: 0.2283 Validation Accuracy: 0.864000 Epoch 51, CIFAR-10 Batch 13: Loss: 0.2184 Validation Accuracy: 0.881000 Epoch 51, CIFAR-10 Batch 14: Loss: 0.1828 Validation Accuracy: 0.868200 Epoch 51, CIFAR-10 Batch 15: Loss: 0.1772 Validation Accuracy: 0.881400 Epoch 51, CIFAR-10 Batch 16: Loss: 0.1986 Validation Accuracy: 0.858000 Epoch 51, CIFAR-10 Batch 17: Loss: 0.2404 Validation Accuracy: 0.881000 Epoch 51, CIFAR-10 Batch 18: Loss: 0.1400 Validation Accuracy: 0.873400 Epoch 51, CIFAR-10 Batch 19: Loss: 0.1441 Validation Accuracy: 0.872400 Epoch 51, CIFAR-10 Batch 20: Loss: 0.2455 Validation Accuracy: 0.879400 Epoch 51, CIFAR-10 Batch 21: Loss: 0.1564 Validation Accuracy: 0.882200 Epoch 51, CIFAR-10 Batch 22: Loss: 0.2056 Validation Accuracy: 0.886600 Epoch 51, CIFAR-10 Batch 23: Loss: 0.1699 Validation Accuracy: 0.880200 Epoch 51, CIFAR-10 Batch 24: Loss: 0.1938 Validation Accuracy: 0.874600 Epoch 51, CIFAR-10 Batch 25: Loss: 0.2176 Validation Accuracy: 0.851800 Epoch 51, CIFAR-10 Batch 26: Loss: 0.1798 Validation Accuracy: 0.865000 Epoch 51, CIFAR-10 Batch 27: Loss: 0.1574 Validation Accuracy: 0.872800 Epoch 51, CIFAR-10 Batch 28: Loss: 0.3185 Validation Accuracy: 0.884000 Epoch 51, CIFAR-10 Batch 29: Loss: 0.1850 Validation Accuracy: 0.864600 Epoch 51, CIFAR-10 Batch 30: Loss: 0.1587 Validation Accuracy: 0.880600 Epoch 51, CIFAR-10 Batch 31: Loss: 0.1550 Validation Accuracy: 0.874600 Epoch 51, CIFAR-10 Batch 32: Loss: 0.1452 Validation Accuracy: 0.885400 Epoch 51, CIFAR-10 Batch 33: Loss: 0.2627 Validation Accuracy: 0.879000 Epoch 51, CIFAR-10 Batch 34: Loss: 0.2468 Validation Accuracy: 0.882000 Epoch 51, CIFAR-10 Batch 35: Loss: 0.2426 Validation Accuracy: 0.873000 Epoch 51, CIFAR-10 Batch 36: Loss: 0.2444 Validation Accuracy: 0.871400 Epoch 51, CIFAR-10 Batch 37: Loss: 0.1571 Validation Accuracy: 0.884000 Epoch 51, CIFAR-10 Batch 38: Loss: 0.1515 Validation Accuracy: 0.883400 Epoch 51, CIFAR-10 Batch 39: Loss: 0.1547 Validation Accuracy: 0.878800 Epoch 51, CIFAR-10 Batch 40: Loss: 0.1850 Validation Accuracy: 0.869400 Epoch 51, CIFAR-10 Batch 41: Loss: 0.1622 Validation Accuracy: 0.884800 Epoch 51, CIFAR-10 Batch 42: Loss: 0.2371 Validation Accuracy: 0.878600 Epoch 51, CIFAR-10 Batch 43: Loss: 0.2854 Validation Accuracy: 0.880800 Epoch 51, CIFAR-10 Batch 44: Loss: 0.1675 Validation Accuracy: 0.883400 Epoch 51, CIFAR-10 Batch 45: Loss: 0.1518 Validation Accuracy: 0.885400 Epoch 51, CIFAR-10 Batch 46: Loss: 0.1855 Validation Accuracy: 0.861600 Epoch 51, CIFAR-10 Batch 47: Loss: 0.1854 Validation Accuracy: 0.876600 Epoch 51, CIFAR-10 Batch 48: Loss: 0.1733 Validation Accuracy: 0.857200 Epoch 51, CIFAR-10 Batch 49: Loss: 0.2208 Validation Accuracy: 0.879200 Epoch 51, CIFAR-10 Batch 50: Loss: 0.1968 Validation Accuracy: 0.878000 Epoch 52, CIFAR-10 Batch 1: Loss: 0.1597 Validation Accuracy: 0.872400 Epoch 52, CIFAR-10 Batch 2: Loss: 0.1540 Validation Accuracy: 0.866800 Epoch 52, CIFAR-10 Batch 3: Loss: 0.1526 Validation Accuracy: 0.881400 Epoch 52, CIFAR-10 Batch 4: Loss: 0.1981 Validation Accuracy: 0.873600 Epoch 52, CIFAR-10 Batch 5: Loss: 0.1546 Validation Accuracy: 0.881400 Epoch 52, CIFAR-10 Batch 6: Loss: 0.2825 Validation Accuracy: 0.878200 Epoch 52, CIFAR-10 Batch 7: Loss: 0.1636 Validation Accuracy: 0.875800 Epoch 52, CIFAR-10 Batch 8: Loss: 0.2940 Validation Accuracy: 0.882600 Epoch 52, CIFAR-10 Batch 9: Loss: 0.1616 Validation Accuracy: 0.870400 Epoch 52, CIFAR-10 Batch 10: Loss: 0.1285 Validation Accuracy: 0.882200 Epoch 52, CIFAR-10 Batch 11: Loss: 0.1446 Validation Accuracy: 0.883600 Epoch 52, CIFAR-10 Batch 12: Loss: 0.1979 Validation Accuracy: 0.877400 Epoch 52, CIFAR-10 Batch 13: Loss: 0.1747 Validation Accuracy: 0.867000 Epoch 52, CIFAR-10 Batch 14: Loss: 0.1853 Validation Accuracy: 0.863000 Epoch 52, CIFAR-10 Batch 15: Loss: 0.1528 Validation Accuracy: 0.877200 Epoch 52, CIFAR-10 Batch 16: Loss: 0.1539 Validation Accuracy: 0.874400 Epoch 52, CIFAR-10 Batch 17: Loss: 0.2201 Validation Accuracy: 0.873600 Epoch 52, CIFAR-10 Batch 18: Loss: 0.1551 Validation Accuracy: 0.878000 Epoch 52, CIFAR-10 Batch 19: Loss: 0.1595 Validation Accuracy: 0.874400 Epoch 52, CIFAR-10 Batch 20: Loss: 0.2067 Validation Accuracy: 0.865200 Epoch 52, CIFAR-10 Batch 21: Loss: 0.1680 Validation Accuracy: 0.879400 Epoch 52, CIFAR-10 Batch 22: Loss: 0.1818 Validation Accuracy: 0.849800 Epoch 52, CIFAR-10 Batch 23: Loss: 0.1629 Validation Accuracy: 0.881000 Epoch 52, CIFAR-10 Batch 24: Loss: 0.2252 Validation Accuracy: 0.880400 Epoch 52, CIFAR-10 Batch 25: Loss: 0.1695 Validation Accuracy: 0.865200 Epoch 52, CIFAR-10 Batch 26: Loss: 0.1842 Validation Accuracy: 0.877000 Epoch 52, CIFAR-10 Batch 27: Loss: 0.1415 Validation Accuracy: 0.878800 Epoch 52, CIFAR-10 Batch 28: Loss: 0.3175 Validation Accuracy: 0.870000 Epoch 52, CIFAR-10 Batch 29: Loss: 0.1446 Validation Accuracy: 0.877800 Epoch 52, CIFAR-10 Batch 30: Loss: 0.1454 Validation Accuracy: 0.876600 Epoch 52, CIFAR-10 Batch 31: Loss: 0.1648 Validation Accuracy: 0.880000 Epoch 52, CIFAR-10 Batch 32: Loss: 0.1396 Validation Accuracy: 0.871000 Epoch 52, CIFAR-10 Batch 33: Loss: 0.2649 Validation Accuracy: 0.865800 Epoch 52, CIFAR-10 Batch 34: Loss: 0.3741 Validation Accuracy: 0.867200 Epoch 52, CIFAR-10 Batch 35: Loss: 0.2204 Validation Accuracy: 0.875200 Epoch 52, CIFAR-10 Batch 36: Loss: 0.2768 Validation Accuracy: 0.863800 Epoch 52, CIFAR-10 Batch 37: Loss: 0.1938 Validation Accuracy: 0.855600 Epoch 52, CIFAR-10 Batch 38: Loss: 0.1315 Validation Accuracy: 0.870400 Epoch 52, CIFAR-10 Batch 39: Loss: 0.1494 Validation Accuracy: 0.879200 Epoch 52, CIFAR-10 Batch 40: Loss: 0.2002 Validation Accuracy: 0.874800 Epoch 52, CIFAR-10 Batch 41: Loss: 0.1869 Validation Accuracy: 0.872600 Epoch 52, CIFAR-10 Batch 42: Loss: 0.2211 Validation Accuracy: 0.888800 Epoch 52, CIFAR-10 Batch 43: Loss: 0.2178 Validation Accuracy: 0.881000 Epoch 52, CIFAR-10 Batch 44: Loss: 0.1716 Validation Accuracy: 0.874400 Epoch 52, CIFAR-10 Batch 45: Loss: 0.1577 Validation Accuracy: 0.873200 Epoch 52, CIFAR-10 Batch 46: Loss: 0.1790 Validation Accuracy: 0.846600 Epoch 52, CIFAR-10 Batch 47: Loss: 0.1832 Validation Accuracy: 0.882000 Epoch 52, CIFAR-10 Batch 48: Loss: 0.1693 Validation Accuracy: 0.875400 Epoch 52, CIFAR-10 Batch 49: Loss: 0.2368 Validation Accuracy: 0.887000 Epoch 52, CIFAR-10 Batch 50: Loss: 0.2086 Validation Accuracy: 0.877800 Epoch 53, CIFAR-10 Batch 1: Loss: 0.1797 Validation Accuracy: 0.868000 Epoch 53, CIFAR-10 Batch 2: Loss: 0.2015 Validation Accuracy: 0.882200 Epoch 53, CIFAR-10 Batch 3: Loss: 0.1344 Validation Accuracy: 0.883600 Epoch 53, CIFAR-10 Batch 4: Loss: 0.1520 Validation Accuracy: 0.867600 Epoch 53, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.878800 Epoch 53, CIFAR-10 Batch 6: Loss: 0.2558 Validation Accuracy: 0.883800 Epoch 53, CIFAR-10 Batch 7: Loss: 0.1448 Validation Accuracy: 0.874400 Epoch 53, CIFAR-10 Batch 8: Loss: 0.2175 Validation Accuracy: 0.871600 Epoch 53, CIFAR-10 Batch 9: Loss: 0.2012 Validation Accuracy: 0.869600 Epoch 53, CIFAR-10 Batch 10: Loss: 0.1331 Validation Accuracy: 0.875600 Epoch 53, CIFAR-10 Batch 11: Loss: 0.1768 Validation Accuracy: 0.883600 Epoch 53, CIFAR-10 Batch 12: Loss: 0.1646 Validation Accuracy: 0.874000 Epoch 53, CIFAR-10 Batch 13: Loss: 0.2118 Validation Accuracy: 0.863600 Epoch 53, CIFAR-10 Batch 14: Loss: 0.1631 Validation Accuracy: 0.876000 Epoch 53, CIFAR-10 Batch 15: Loss: 0.1631 Validation Accuracy: 0.881800 Epoch 53, CIFAR-10 Batch 16: Loss: 0.1696 Validation Accuracy: 0.881800 Epoch 53, CIFAR-10 Batch 17: Loss: 0.2164 Validation Accuracy: 0.875600 Epoch 53, CIFAR-10 Batch 18: Loss: 0.1632 Validation Accuracy: 0.870000 Epoch 53, CIFAR-10 Batch 19: Loss: 0.1804 Validation Accuracy: 0.885600 Epoch 53, CIFAR-10 Batch 20: Loss: 0.2213 Validation Accuracy: 0.866200 Epoch 53, CIFAR-10 Batch 21: Loss: 0.1734 Validation Accuracy: 0.884000 Epoch 53, CIFAR-10 Batch 22: Loss: 0.1671 Validation Accuracy: 0.883800 Epoch 53, CIFAR-10 Batch 23: Loss: 0.1647 Validation Accuracy: 0.873400 Epoch 53, CIFAR-10 Batch 24: Loss: 0.1949 Validation Accuracy: 0.887800 Epoch 53, CIFAR-10 Batch 25: Loss: 0.1833 Validation Accuracy: 0.867800 Epoch 53, CIFAR-10 Batch 26: Loss: 0.2311 Validation Accuracy: 0.873800 Epoch 53, CIFAR-10 Batch 27: Loss: 0.1390 Validation Accuracy: 0.874800 Epoch 53, CIFAR-10 Batch 28: Loss: 0.2600 Validation Accuracy: 0.880000 Epoch 53, CIFAR-10 Batch 29: Loss: 0.1500 Validation Accuracy: 0.873600 Epoch 53, CIFAR-10 Batch 30: Loss: 0.1329 Validation Accuracy: 0.878800 Epoch 53, CIFAR-10 Batch 31: Loss: 0.1613 Validation Accuracy: 0.864600 Epoch 53, CIFAR-10 Batch 32: Loss: 0.1719 Validation Accuracy: 0.880800 Epoch 53, CIFAR-10 Batch 33: Loss: 0.1979 Validation Accuracy: 0.878800 Epoch 53, CIFAR-10 Batch 34: Loss: 0.3178 Validation Accuracy: 0.885600 Epoch 53, CIFAR-10 Batch 35: Loss: 0.2547 Validation Accuracy: 0.870600 Epoch 53, CIFAR-10 Batch 36: Loss: 0.2577 Validation Accuracy: 0.874400 Epoch 53, CIFAR-10 Batch 37: Loss: 0.1575 Validation Accuracy: 0.863600 Epoch 53, CIFAR-10 Batch 38: Loss: 0.1308 Validation Accuracy: 0.876200 Epoch 53, CIFAR-10 Batch 39: Loss: 0.1354 Validation Accuracy: 0.881000 Epoch 53, CIFAR-10 Batch 40: Loss: 0.1839 Validation Accuracy: 0.877600 Epoch 53, CIFAR-10 Batch 41: Loss: 0.1642 Validation Accuracy: 0.882600 Epoch 53, CIFAR-10 Batch 42: Loss: 0.2054 Validation Accuracy: 0.863400 Epoch 53, CIFAR-10 Batch 43: Loss: 0.2755 Validation Accuracy: 0.863600 Epoch 53, CIFAR-10 Batch 44: Loss: 0.1550 Validation Accuracy: 0.864200 Epoch 53, CIFAR-10 Batch 45: Loss: 0.2039 Validation Accuracy: 0.884600 Epoch 53, CIFAR-10 Batch 46: Loss: 0.1956 Validation Accuracy: 0.873800 Epoch 53, CIFAR-10 Batch 47: Loss: 0.1627 Validation Accuracy: 0.877000 Epoch 53, CIFAR-10 Batch 48: Loss: 0.1768 Validation Accuracy: 0.883400 Epoch 53, CIFAR-10 Batch 49: Loss: 0.1929 Validation Accuracy: 0.879000 Epoch 53, CIFAR-10 Batch 50: Loss: 0.1666 Validation Accuracy: 0.883600 Epoch 54, CIFAR-10 Batch 1: Loss: 0.1642 Validation Accuracy: 0.859200 Epoch 54, CIFAR-10 Batch 2: Loss: 0.1574 Validation Accuracy: 0.884200 Epoch 54, CIFAR-10 Batch 3: Loss: 0.1323 Validation Accuracy: 0.884400 Epoch 54, CIFAR-10 Batch 4: Loss: 0.1573 Validation Accuracy: 0.878800 Epoch 54, CIFAR-10 Batch 5: Loss: 0.1825 Validation Accuracy: 0.881000 Epoch 54, CIFAR-10 Batch 6: Loss: 0.2870 Validation Accuracy: 0.863400 Epoch 54, CIFAR-10 Batch 7: Loss: 0.1702 Validation Accuracy: 0.869000 Epoch 54, CIFAR-10 Batch 8: Loss: 0.2320 Validation Accuracy: 0.876200 Epoch 54, CIFAR-10 Batch 9: Loss: 0.1517 Validation Accuracy: 0.877200 Epoch 54, CIFAR-10 Batch 10: Loss: 0.1285 Validation Accuracy: 0.872400 Epoch 54, CIFAR-10 Batch 11: Loss: 0.1393 Validation Accuracy: 0.841800 Epoch 54, CIFAR-10 Batch 12: Loss: 0.1656 Validation Accuracy: 0.859000 Epoch 54, CIFAR-10 Batch 13: Loss: 0.1634 Validation Accuracy: 0.880800 Epoch 54, CIFAR-10 Batch 14: Loss: 0.1712 Validation Accuracy: 0.875600 Epoch 54, CIFAR-10 Batch 15: Loss: 0.1506 Validation Accuracy: 0.879000 Epoch 54, CIFAR-10 Batch 16: Loss: 0.1705 Validation Accuracy: 0.866200 Epoch 54, CIFAR-10 Batch 17: Loss: 0.2011 Validation Accuracy: 0.865400 Epoch 54, CIFAR-10 Batch 18: Loss: 0.1887 Validation Accuracy: 0.854400 Epoch 54, CIFAR-10 Batch 19: Loss: 0.1405 Validation Accuracy: 0.870200 Epoch 54, CIFAR-10 Batch 20: Loss: 0.2730 Validation Accuracy: 0.879800 Epoch 54, CIFAR-10 Batch 21: Loss: 0.1649 Validation Accuracy: 0.882400 Epoch 54, CIFAR-10 Batch 22: Loss: 0.2211 Validation Accuracy: 0.880800 Epoch 54, CIFAR-10 Batch 23: Loss: 0.1812 Validation Accuracy: 0.871800 Epoch 54, CIFAR-10 Batch 24: Loss: 0.1666 Validation Accuracy: 0.884800 Epoch 54, CIFAR-10 Batch 25: Loss: 0.2147 Validation Accuracy: 0.866400 Epoch 54, CIFAR-10 Batch 26: Loss: 0.1733 Validation Accuracy: 0.888000 Epoch 54, CIFAR-10 Batch 27: Loss: 0.1365 Validation Accuracy: 0.885000 Epoch 54, CIFAR-10 Batch 28: Loss: 0.2813 Validation Accuracy: 0.877200 Epoch 54, CIFAR-10 Batch 29: Loss: 0.1756 Validation Accuracy: 0.878000 Epoch 54, CIFAR-10 Batch 30: Loss: 0.1329 Validation Accuracy: 0.878200 Epoch 54, CIFAR-10 Batch 31: Loss: 0.1686 Validation Accuracy: 0.882600 Epoch 54, CIFAR-10 Batch 32: Loss: 0.1522 Validation Accuracy: 0.869400 Epoch 54, CIFAR-10 Batch 33: Loss: 0.2398 Validation Accuracy: 0.868600 Epoch 54, CIFAR-10 Batch 34: Loss: 0.2287 Validation Accuracy: 0.875000 Epoch 54, CIFAR-10 Batch 35: Loss: 0.2282 Validation Accuracy: 0.874200 Epoch 54, CIFAR-10 Batch 36: Loss: 0.2711 Validation Accuracy: 0.872600 Epoch 54, CIFAR-10 Batch 37: Loss: 0.1704 Validation Accuracy: 0.861800 Epoch 54, CIFAR-10 Batch 38: Loss: 0.1367 Validation Accuracy: 0.882000 Epoch 54, CIFAR-10 Batch 39: Loss: 0.1336 Validation Accuracy: 0.878400 Epoch 54, CIFAR-10 Batch 40: Loss: 0.1873 Validation Accuracy: 0.874000 Epoch 54, CIFAR-10 Batch 41: Loss: 0.1670 Validation Accuracy: 0.877000 Epoch 54, CIFAR-10 Batch 42: Loss: 0.1866 Validation Accuracy: 0.889600 Epoch 54, CIFAR-10 Batch 43: Loss: 0.2432 Validation Accuracy: 0.881800 Epoch 54, CIFAR-10 Batch 44: Loss: 0.1950 Validation Accuracy: 0.880000 Epoch 54, CIFAR-10 Batch 45: Loss: 0.1759 Validation Accuracy: 0.876000 Epoch 54, CIFAR-10 Batch 46: Loss: 0.1774 Validation Accuracy: 0.886400 Epoch 54, CIFAR-10 Batch 47: Loss: 0.1647 Validation Accuracy: 0.880200 Epoch 54, CIFAR-10 Batch 48: Loss: 0.1552 Validation Accuracy: 0.882000 Epoch 54, CIFAR-10 Batch 49: Loss: 0.2405 Validation Accuracy: 0.878600 Epoch 54, CIFAR-10 Batch 50: Loss: 0.1890 Validation Accuracy: 0.872400 Epoch 55, CIFAR-10 Batch 1: Loss: 0.1460 Validation Accuracy: 0.871600 Epoch 55, CIFAR-10 Batch 2: Loss: 0.1460 Validation Accuracy: 0.880800 Epoch 55, CIFAR-10 Batch 3: Loss: 0.1371 Validation Accuracy: 0.873400 Epoch 55, CIFAR-10 Batch 4: Loss: 0.1448 Validation Accuracy: 0.875000 Epoch 55, CIFAR-10 Batch 5: Loss: 0.1605 Validation Accuracy: 0.880200 Epoch 55, CIFAR-10 Batch 6: Loss: 0.2429 Validation Accuracy: 0.875600 Epoch 55, CIFAR-10 Batch 7: Loss: 0.1398 Validation Accuracy: 0.885200 Epoch 55, CIFAR-10 Batch 8: Loss: 0.2766 Validation Accuracy: 0.881000 Epoch 55, CIFAR-10 Batch 9: Loss: 0.1620 Validation Accuracy: 0.874000 Epoch 55, CIFAR-10 Batch 10: Loss: 0.1406 Validation Accuracy: 0.883000 Epoch 55, CIFAR-10 Batch 11: Loss: 0.1614 Validation Accuracy: 0.880800 Epoch 55, CIFAR-10 Batch 12: Loss: 0.1704 Validation Accuracy: 0.878800 Epoch 55, CIFAR-10 Batch 13: Loss: 0.2114 Validation Accuracy: 0.880200 Epoch 55, CIFAR-10 Batch 14: Loss: 0.1858 Validation Accuracy: 0.878400 Epoch 55, CIFAR-10 Batch 15: Loss: 0.1760 Validation Accuracy: 0.888000 Epoch 55, CIFAR-10 Batch 16: Loss: 0.1484 Validation Accuracy: 0.877600 Epoch 55, CIFAR-10 Batch 17: Loss: 0.2252 Validation Accuracy: 0.868000 Epoch 55, CIFAR-10 Batch 18: Loss: 0.1548 Validation Accuracy: 0.861600 Epoch 55, CIFAR-10 Batch 19: Loss: 0.1820 Validation Accuracy: 0.880600 Epoch 55, CIFAR-10 Batch 20: Loss: 0.2484 Validation Accuracy: 0.869200 Epoch 55, CIFAR-10 Batch 21: Loss: 0.1484 Validation Accuracy: 0.886400 Epoch 55, CIFAR-10 Batch 22: Loss: 0.1683 Validation Accuracy: 0.883000 Epoch 55, CIFAR-10 Batch 23: Loss: 0.1984 Validation Accuracy: 0.873600 Epoch 55, CIFAR-10 Batch 24: Loss: 0.1707 Validation Accuracy: 0.880400 Epoch 55, CIFAR-10 Batch 25: Loss: 0.2612 Validation Accuracy: 0.855400 Epoch 55, CIFAR-10 Batch 26: Loss: 0.2058 Validation Accuracy: 0.885600 Epoch 55, CIFAR-10 Batch 27: Loss: 0.1441 Validation Accuracy: 0.873200 Epoch 55, CIFAR-10 Batch 28: Loss: 0.2259 Validation Accuracy: 0.872600 Epoch 55, CIFAR-10 Batch 29: Loss: 0.1782 Validation Accuracy: 0.876000 Epoch 55, CIFAR-10 Batch 30: Loss: 0.1649 Validation Accuracy: 0.883200 Epoch 55, CIFAR-10 Batch 31: Loss: 0.1985 Validation Accuracy: 0.874400 Epoch 55, CIFAR-10 Batch 32: Loss: 0.1360 Validation Accuracy: 0.870800 Epoch 55, CIFAR-10 Batch 33: Loss: 0.2175 Validation Accuracy: 0.870800 Epoch 55, CIFAR-10 Batch 34: Loss: 0.2829 Validation Accuracy: 0.845600 Epoch 55, CIFAR-10 Batch 35: Loss: 0.2028 Validation Accuracy: 0.884200 Epoch 55, CIFAR-10 Batch 36: Loss: 0.2220 Validation Accuracy: 0.863200 Epoch 55, CIFAR-10 Batch 37: Loss: 0.1486 Validation Accuracy: 0.867200 Epoch 55, CIFAR-10 Batch 38: Loss: 0.1445 Validation Accuracy: 0.872000 Epoch 55, CIFAR-10 Batch 39: Loss: 0.1517 Validation Accuracy: 0.872600 Epoch 55, CIFAR-10 Batch 40: Loss: 0.1755 Validation Accuracy: 0.866800 Epoch 55, CIFAR-10 Batch 41: Loss: 0.1713 Validation Accuracy: 0.877000 Epoch 55, CIFAR-10 Batch 42: Loss: 0.1738 Validation Accuracy: 0.872000 Epoch 55, CIFAR-10 Batch 43: Loss: 0.2738 Validation Accuracy: 0.887000 Epoch 55, CIFAR-10 Batch 44: Loss: 0.1752 Validation Accuracy: 0.875400 Epoch 55, CIFAR-10 Batch 45: Loss: 0.1561 Validation Accuracy: 0.888400 Epoch 55, CIFAR-10 Batch 46: Loss: 0.1756 Validation Accuracy: 0.862600 Epoch 55, CIFAR-10 Batch 47: Loss: 0.1612 Validation Accuracy: 0.881000 Epoch 55, CIFAR-10 Batch 48: Loss: 0.1550 Validation Accuracy: 0.872600 Epoch 55, CIFAR-10 Batch 49: Loss: 0.2193 Validation Accuracy: 0.877000 Epoch 55, CIFAR-10 Batch 50: Loss: 0.1623 Validation Accuracy: 0.871400 Epoch 56, CIFAR-10 Batch 1: Loss: 0.1409 Validation Accuracy: 0.878600 Epoch 56, CIFAR-10 Batch 2: Loss: 0.1888 Validation Accuracy: 0.873800 Epoch 56, CIFAR-10 Batch 3: Loss: 0.1364 Validation Accuracy: 0.882200 Epoch 56, CIFAR-10 Batch 4: Loss: 0.1469 Validation Accuracy: 0.885400 Epoch 56, CIFAR-10 Batch 5: Loss: 0.1620 Validation Accuracy: 0.884400 Epoch 56, CIFAR-10 Batch 6: Loss: 0.3087 Validation Accuracy: 0.871400 Epoch 56, CIFAR-10 Batch 7: Loss: 0.1912 Validation Accuracy: 0.879400 Epoch 56, CIFAR-10 Batch 8: Loss: 0.2258 Validation Accuracy: 0.880800 Epoch 56, CIFAR-10 Batch 9: Loss: 0.1441 Validation Accuracy: 0.887800 Epoch 56, CIFAR-10 Batch 10: Loss: 0.1326 Validation Accuracy: 0.878400 Epoch 56, CIFAR-10 Batch 11: Loss: 0.1675 Validation Accuracy: 0.869600 Epoch 56, CIFAR-10 Batch 12: Loss: 0.1523 Validation Accuracy: 0.880400 Epoch 56, CIFAR-10 Batch 13: Loss: 0.1668 Validation Accuracy: 0.875000 Epoch 56, CIFAR-10 Batch 14: Loss: 0.1544 Validation Accuracy: 0.872800 Epoch 56, CIFAR-10 Batch 15: Loss: 0.1553 Validation Accuracy: 0.866400 Epoch 56, CIFAR-10 Batch 16: Loss: 0.1526 Validation Accuracy: 0.872400 Epoch 56, CIFAR-10 Batch 17: Loss: 0.2086 Validation Accuracy: 0.879800 Epoch 56, CIFAR-10 Batch 18: Loss: 0.1449 Validation Accuracy: 0.871400 Epoch 56, CIFAR-10 Batch 19: Loss: 0.1374 Validation Accuracy: 0.877800 Epoch 56, CIFAR-10 Batch 20: Loss: 0.2662 Validation Accuracy: 0.885200 Epoch 56, CIFAR-10 Batch 21: Loss: 0.1737 Validation Accuracy: 0.877800 Epoch 56, CIFAR-10 Batch 22: Loss: 0.1694 Validation Accuracy: 0.880400 Epoch 56, CIFAR-10 Batch 23: Loss: 0.1826 Validation Accuracy: 0.875000 Epoch 56, CIFAR-10 Batch 24: Loss: 0.2136 Validation Accuracy: 0.879000 Epoch 56, CIFAR-10 Batch 25: Loss: 0.1872 Validation Accuracy: 0.870000 Epoch 56, CIFAR-10 Batch 26: Loss: 0.1798 Validation Accuracy: 0.876800 Epoch 56, CIFAR-10 Batch 27: Loss: 0.1427 Validation Accuracy: 0.868000 Epoch 56, CIFAR-10 Batch 28: Loss: 0.2244 Validation Accuracy: 0.881200 Epoch 56, CIFAR-10 Batch 29: Loss: 0.1512 Validation Accuracy: 0.874800 Epoch 56, CIFAR-10 Batch 30: Loss: 0.1373 Validation Accuracy: 0.874800 Epoch 56, CIFAR-10 Batch 31: Loss: 0.1651 Validation Accuracy: 0.879800 Epoch 56, CIFAR-10 Batch 32: Loss: 0.1509 Validation Accuracy: 0.873600 Epoch 56, CIFAR-10 Batch 33: Loss: 0.2205 Validation Accuracy: 0.858800 Epoch 56, CIFAR-10 Batch 34: Loss: 0.2955 Validation Accuracy: 0.855000 Epoch 56, CIFAR-10 Batch 35: Loss: 0.2586 Validation Accuracy: 0.882000 Epoch 56, CIFAR-10 Batch 36: Loss: 0.2572 Validation Accuracy: 0.879200 Epoch 56, CIFAR-10 Batch 37: Loss: 0.1796 Validation Accuracy: 0.885000 Epoch 56, CIFAR-10 Batch 38: Loss: 0.1422 Validation Accuracy: 0.876000 Epoch 56, CIFAR-10 Batch 39: Loss: 0.1331 Validation Accuracy: 0.875000 Epoch 56, CIFAR-10 Batch 40: Loss: 0.1902 Validation Accuracy: 0.879400 Epoch 56, CIFAR-10 Batch 41: Loss: 0.1891 Validation Accuracy: 0.880200 Epoch 56, CIFAR-10 Batch 42: Loss: 0.1894 Validation Accuracy: 0.867000 Epoch 56, CIFAR-10 Batch 43: Loss: 0.2344 Validation Accuracy: 0.875000 Epoch 56, CIFAR-10 Batch 44: Loss: 0.1807 Validation Accuracy: 0.876800 Epoch 56, CIFAR-10 Batch 45: Loss: 0.1661 Validation Accuracy: 0.879200 Epoch 56, CIFAR-10 Batch 46: Loss: 0.1920 Validation Accuracy: 0.867400 Epoch 56, CIFAR-10 Batch 47: Loss: 0.1665 Validation Accuracy: 0.874000 Epoch 56, CIFAR-10 Batch 48: Loss: 0.1726 Validation Accuracy: 0.883800 Epoch 56, CIFAR-10 Batch 49: Loss: 0.2154 Validation Accuracy: 0.870800 Epoch 56, CIFAR-10 Batch 50: Loss: 0.1799 Validation Accuracy: 0.890800 Epoch 57, CIFAR-10 Batch 1: Loss: 0.2063 Validation Accuracy: 0.881000 Epoch 57, CIFAR-10 Batch 2: Loss: 0.1686 Validation Accuracy: 0.869200 Epoch 57, CIFAR-10 Batch 3: Loss: 0.1407 Validation Accuracy: 0.871800 Epoch 57, CIFAR-10 Batch 4: Loss: 0.1984 Validation Accuracy: 0.884000 Epoch 57, CIFAR-10 Batch 5: Loss: 0.1823 Validation Accuracy: 0.874600 Epoch 57, CIFAR-10 Batch 6: Loss: 0.2652 Validation Accuracy: 0.882200 Epoch 57, CIFAR-10 Batch 7: Loss: 0.1844 Validation Accuracy: 0.865000 Epoch 57, CIFAR-10 Batch 8: Loss: 0.2091 Validation Accuracy: 0.885400 Epoch 57, CIFAR-10 Batch 9: Loss: 0.1843 Validation Accuracy: 0.861800 Epoch 57, CIFAR-10 Batch 10: Loss: 0.1353 Validation Accuracy: 0.873800 Epoch 57, CIFAR-10 Batch 11: Loss: 0.1954 Validation Accuracy: 0.871600 Epoch 57, CIFAR-10 Batch 12: Loss: 0.1598 Validation Accuracy: 0.863800 Epoch 57, CIFAR-10 Batch 13: Loss: 0.1706 Validation Accuracy: 0.873400 Epoch 57, CIFAR-10 Batch 14: Loss: 0.1696 Validation Accuracy: 0.875600 Epoch 57, CIFAR-10 Batch 15: Loss: 0.1582 Validation Accuracy: 0.882000 Epoch 57, CIFAR-10 Batch 16: Loss: 0.1796 Validation Accuracy: 0.877600 Epoch 57, CIFAR-10 Batch 17: Loss: 0.2256 Validation Accuracy: 0.864800 Epoch 57, CIFAR-10 Batch 18: Loss: 0.1541 Validation Accuracy: 0.864400 Epoch 57, CIFAR-10 Batch 19: Loss: 0.1561 Validation Accuracy: 0.873000 Epoch 57, CIFAR-10 Batch 20: Loss: 0.2213 Validation Accuracy: 0.875800 Epoch 57, CIFAR-10 Batch 21: Loss: 0.1444 Validation Accuracy: 0.871800 Epoch 57, CIFAR-10 Batch 22: Loss: 0.1782 Validation Accuracy: 0.885800 Epoch 57, CIFAR-10 Batch 23: Loss: 0.1660 Validation Accuracy: 0.890200 Epoch 57, CIFAR-10 Batch 24: Loss: 0.1752 Validation Accuracy: 0.881000 Epoch 57, CIFAR-10 Batch 25: Loss: 0.2166 Validation Accuracy: 0.865000 Epoch 57, CIFAR-10 Batch 26: Loss: 0.1849 Validation Accuracy: 0.880400 Epoch 57, CIFAR-10 Batch 27: Loss: 0.1460 Validation Accuracy: 0.877400 Epoch 57, CIFAR-10 Batch 28: Loss: 0.2796 Validation Accuracy: 0.867200 Epoch 57, CIFAR-10 Batch 29: Loss: 0.1546 Validation Accuracy: 0.877800 Epoch 57, CIFAR-10 Batch 30: Loss: 0.1503 Validation Accuracy: 0.882000 Epoch 57, CIFAR-10 Batch 31: Loss: 0.1564 Validation Accuracy: 0.878000 Epoch 57, CIFAR-10 Batch 32: Loss: 0.1437 Validation Accuracy: 0.874800 Epoch 57, CIFAR-10 Batch 33: Loss: 0.2279 Validation Accuracy: 0.882000 Epoch 57, CIFAR-10 Batch 34: Loss: 0.2848 Validation Accuracy: 0.875000 Epoch 57, CIFAR-10 Batch 35: Loss: 0.2473 Validation Accuracy: 0.867600 Epoch 57, CIFAR-10 Batch 36: Loss: 0.2755 Validation Accuracy: 0.870600 Epoch 57, CIFAR-10 Batch 37: Loss: 0.1457 Validation Accuracy: 0.874600 Epoch 57, CIFAR-10 Batch 38: Loss: 0.1313 Validation Accuracy: 0.877400 Epoch 57, CIFAR-10 Batch 39: Loss: 0.1318 Validation Accuracy: 0.885400 Epoch 57, CIFAR-10 Batch 40: Loss: 0.1596 Validation Accuracy: 0.876800 Epoch 57, CIFAR-10 Batch 41: Loss: 0.1642 Validation Accuracy: 0.866000 Epoch 57, CIFAR-10 Batch 42: Loss: 0.1659 Validation Accuracy: 0.877200 Epoch 57, CIFAR-10 Batch 43: Loss: 0.2733 Validation Accuracy: 0.883200 Epoch 57, CIFAR-10 Batch 44: Loss: 0.1744 Validation Accuracy: 0.866400 Epoch 57, CIFAR-10 Batch 45: Loss: 0.1472 Validation Accuracy: 0.886000 Epoch 57, CIFAR-10 Batch 46: Loss: 0.2041 Validation Accuracy: 0.878200 Epoch 57, CIFAR-10 Batch 47: Loss: 0.1569 Validation Accuracy: 0.881800 Epoch 57, CIFAR-10 Batch 48: Loss: 0.2044 Validation Accuracy: 0.886000 Epoch 57, CIFAR-10 Batch 49: Loss: 0.2231 Validation Accuracy: 0.872600 Epoch 57, CIFAR-10 Batch 50: Loss: 0.1617 Validation Accuracy: 0.885200 Epoch 58, CIFAR-10 Batch 1: Loss: 0.1588 Validation Accuracy: 0.889800 Epoch 58, CIFAR-10 Batch 2: Loss: 0.1833 Validation Accuracy: 0.887200 Epoch 58, CIFAR-10 Batch 3: Loss: 0.1811 Validation Accuracy: 0.875000 Epoch 58, CIFAR-10 Batch 4: Loss: 0.2274 Validation Accuracy: 0.887600 Epoch 58, CIFAR-10 Batch 5: Loss: 0.1660 Validation Accuracy: 0.889800 Epoch 58, CIFAR-10 Batch 6: Loss: 0.3195 Validation Accuracy: 0.874000 Epoch 58, CIFAR-10 Batch 7: Loss: 0.1507 Validation Accuracy: 0.878400 Epoch 58, CIFAR-10 Batch 8: Loss: 0.1985 Validation Accuracy: 0.889600 Epoch 58, CIFAR-10 Batch 9: Loss: 0.1826 Validation Accuracy: 0.875400 Epoch 58, CIFAR-10 Batch 10: Loss: 0.1311 Validation Accuracy: 0.883000 Epoch 58, CIFAR-10 Batch 11: Loss: 0.2147 Validation Accuracy: 0.887600 Epoch 58, CIFAR-10 Batch 12: Loss: 0.1765 Validation Accuracy: 0.872400 Epoch 58, CIFAR-10 Batch 13: Loss: 0.2065 Validation Accuracy: 0.858800 Epoch 58, CIFAR-10 Batch 14: Loss: 0.2427 Validation Accuracy: 0.872600 Epoch 58, CIFAR-10 Batch 15: Loss: 0.1603 Validation Accuracy: 0.880000 Epoch 58, CIFAR-10 Batch 16: Loss: 0.1592 Validation Accuracy: 0.884600 Epoch 58, CIFAR-10 Batch 17: Loss: 0.1955 Validation Accuracy: 0.871600 Epoch 58, CIFAR-10 Batch 18: Loss: 0.1530 Validation Accuracy: 0.864200 Epoch 58, CIFAR-10 Batch 19: Loss: 0.1592 Validation Accuracy: 0.869600 Epoch 58, CIFAR-10 Batch 20: Loss: 0.2351 Validation Accuracy: 0.882400 Epoch 58, CIFAR-10 Batch 21: Loss: 0.1601 Validation Accuracy: 0.874000 Epoch 58, CIFAR-10 Batch 22: Loss: 0.1813 Validation Accuracy: 0.870200 Epoch 58, CIFAR-10 Batch 23: Loss: 0.1647 Validation Accuracy: 0.885400 Epoch 58, CIFAR-10 Batch 24: Loss: 0.1786 Validation Accuracy: 0.880400 Epoch 58, CIFAR-10 Batch 25: Loss: 0.1680 Validation Accuracy: 0.871000 Epoch 58, CIFAR-10 Batch 26: Loss: 0.1755 Validation Accuracy: 0.887000 Epoch 58, CIFAR-10 Batch 27: Loss: 0.1687 Validation Accuracy: 0.870400 Epoch 58, CIFAR-10 Batch 28: Loss: 0.2120 Validation Accuracy: 0.866800 Epoch 58, CIFAR-10 Batch 29: Loss: 0.1435 Validation Accuracy: 0.877200 Epoch 58, CIFAR-10 Batch 30: Loss: 0.1322 Validation Accuracy: 0.864600 Epoch 58, CIFAR-10 Batch 31: Loss: 0.1420 Validation Accuracy: 0.884000 Epoch 58, CIFAR-10 Batch 32: Loss: 0.1599 Validation Accuracy: 0.881200 Epoch 58, CIFAR-10 Batch 33: Loss: 0.2136 Validation Accuracy: 0.869400 Epoch 58, CIFAR-10 Batch 34: Loss: 0.2683 Validation Accuracy: 0.876800 Epoch 58, CIFAR-10 Batch 35: Loss: 0.2515 Validation Accuracy: 0.878800 Epoch 58, CIFAR-10 Batch 36: Loss: 0.2490 Validation Accuracy: 0.869000 Epoch 58, CIFAR-10 Batch 37: Loss: 0.1648 Validation Accuracy: 0.875800 Epoch 58, CIFAR-10 Batch 38: Loss: 0.1401 Validation Accuracy: 0.876400 Epoch 58, CIFAR-10 Batch 39: Loss: 0.1332 Validation Accuracy: 0.882000 Epoch 58, CIFAR-10 Batch 40: Loss: 0.1554 Validation Accuracy: 0.860600 Epoch 58, CIFAR-10 Batch 41: Loss: 0.1743 Validation Accuracy: 0.882200 Epoch 58, CIFAR-10 Batch 42: Loss: 0.1791 Validation Accuracy: 0.859000 Epoch 58, CIFAR-10 Batch 43: Loss: 0.2543 Validation Accuracy: 0.880800 Epoch 58, CIFAR-10 Batch 44: Loss: 0.1891 Validation Accuracy: 0.861800 Epoch 58, CIFAR-10 Batch 45: Loss: 0.1474 Validation Accuracy: 0.882400 Epoch 58, CIFAR-10 Batch 46: Loss: 0.1711 Validation Accuracy: 0.874600 Epoch 58, CIFAR-10 Batch 47: Loss: 0.1555 Validation Accuracy: 0.883600 Epoch 58, CIFAR-10 Batch 48: Loss: 0.1977 Validation Accuracy: 0.871000 Epoch 58, CIFAR-10 Batch 49: Loss: 0.2040 Validation Accuracy: 0.884800 Epoch 58, CIFAR-10 Batch 50: Loss: 0.1856 Validation Accuracy: 0.882600 Epoch 59, CIFAR-10 Batch 1: Loss: 0.1503 Validation Accuracy: 0.884200 Epoch 59, CIFAR-10 Batch 2: Loss: 0.1525 Validation Accuracy: 0.882400 Epoch 59, CIFAR-10 Batch 3: Loss: 0.1545 Validation Accuracy: 0.882600 Epoch 59, CIFAR-10 Batch 4: Loss: 0.1676 Validation Accuracy: 0.871000 Epoch 59, CIFAR-10 Batch 5: Loss: 0.2004 Validation Accuracy: 0.886600 Epoch 59, CIFAR-10 Batch 6: Loss: 0.2685 Validation Accuracy: 0.879800 Epoch 59, CIFAR-10 Batch 7: Loss: 0.1493 Validation Accuracy: 0.870800 Epoch 59, CIFAR-10 Batch 8: Loss: 0.2077 Validation Accuracy: 0.877800 Epoch 59, CIFAR-10 Batch 9: Loss: 0.1720 Validation Accuracy: 0.872800 Epoch 59, CIFAR-10 Batch 10: Loss: 0.1332 Validation Accuracy: 0.881200 Epoch 59, CIFAR-10 Batch 11: Loss: 0.1451 Validation Accuracy: 0.880200 Epoch 59, CIFAR-10 Batch 12: Loss: 0.1763 Validation Accuracy: 0.877800 Epoch 59, CIFAR-10 Batch 13: Loss: 0.1920 Validation Accuracy: 0.868400 Epoch 59, CIFAR-10 Batch 14: Loss: 0.1669 Validation Accuracy: 0.868000 Epoch 59, CIFAR-10 Batch 15: Loss: 0.1750 Validation Accuracy: 0.882200 Epoch 59, CIFAR-10 Batch 16: Loss: 0.1619 Validation Accuracy: 0.863000 Epoch 59, CIFAR-10 Batch 17: Loss: 0.2492 Validation Accuracy: 0.868800 Epoch 59, CIFAR-10 Batch 18: Loss: 0.1867 Validation Accuracy: 0.855000 Epoch 59, CIFAR-10 Batch 19: Loss: 0.1452 Validation Accuracy: 0.868600 Epoch 59, CIFAR-10 Batch 20: Loss: 0.2340 Validation Accuracy: 0.877600 Epoch 59, CIFAR-10 Batch 21: Loss: 0.1450 Validation Accuracy: 0.881200 Epoch 59, CIFAR-10 Batch 22: Loss: 0.1760 Validation Accuracy: 0.874400 Epoch 59, CIFAR-10 Batch 23: Loss: 0.1495 Validation Accuracy: 0.889400 Epoch 59, CIFAR-10 Batch 24: Loss: 0.1965 Validation Accuracy: 0.884400 Epoch 59, CIFAR-10 Batch 25: Loss: 0.1641 Validation Accuracy: 0.878800 Epoch 59, CIFAR-10 Batch 26: Loss: 0.1723 Validation Accuracy: 0.878000 Epoch 59, CIFAR-10 Batch 27: Loss: 0.1353 Validation Accuracy: 0.883200 Epoch 59, CIFAR-10 Batch 28: Loss: 0.3045 Validation Accuracy: 0.889200 Epoch 59, CIFAR-10 Batch 29: Loss: 0.1598 Validation Accuracy: 0.874800 Epoch 59, CIFAR-10 Batch 30: Loss: 0.1354 Validation Accuracy: 0.873600 Epoch 59, CIFAR-10 Batch 31: Loss: 0.1382 Validation Accuracy: 0.877000 Epoch 59, CIFAR-10 Batch 32: Loss: 0.1404 Validation Accuracy: 0.879400 Epoch 59, CIFAR-10 Batch 33: Loss: 0.2157 Validation Accuracy: 0.877600 Epoch 59, CIFAR-10 Batch 34: Loss: 0.2377 Validation Accuracy: 0.866200 Epoch 59, CIFAR-10 Batch 35: Loss: 0.2104 Validation Accuracy: 0.876400 Epoch 59, CIFAR-10 Batch 36: Loss: 0.2696 Validation Accuracy: 0.881200 Epoch 59, CIFAR-10 Batch 37: Loss: 0.1700 Validation Accuracy: 0.876200 Epoch 59, CIFAR-10 Batch 38: Loss: 0.1323 Validation Accuracy: 0.884600 Epoch 59, CIFAR-10 Batch 39: Loss: 0.1332 Validation Accuracy: 0.882400 Epoch 59, CIFAR-10 Batch 40: Loss: 0.1981 Validation Accuracy: 0.879400 Epoch 59, CIFAR-10 Batch 41: Loss: 0.1555 Validation Accuracy: 0.872400 Epoch 59, CIFAR-10 Batch 42: Loss: 0.1932 Validation Accuracy: 0.874000 Epoch 59, CIFAR-10 Batch 43: Loss: 0.2457 Validation Accuracy: 0.880000 Epoch 59, CIFAR-10 Batch 44: Loss: 0.1903 Validation Accuracy: 0.877600 Epoch 59, CIFAR-10 Batch 45: Loss: 0.1461 Validation Accuracy: 0.877400 Epoch 59, CIFAR-10 Batch 46: Loss: 0.1510 Validation Accuracy: 0.872000 Epoch 59, CIFAR-10 Batch 47: Loss: 0.2026 Validation Accuracy: 0.886600 Epoch 59, CIFAR-10 Batch 48: Loss: 0.1512 Validation Accuracy: 0.871200 Epoch 59, CIFAR-10 Batch 49: Loss: 0.2174 Validation Accuracy: 0.879400 Epoch 59, CIFAR-10 Batch 50: Loss: 0.1656 Validation Accuracy: 0.865400 Epoch 60, CIFAR-10 Batch 1: Loss: 0.1443 Validation Accuracy: 0.870800 Epoch 60, CIFAR-10 Batch 2: Loss: 0.1699 Validation Accuracy: 0.878800 Epoch 60, CIFAR-10 Batch 3: Loss: 0.1855 Validation Accuracy: 0.883000 Epoch 60, CIFAR-10 Batch 4: Loss: 0.1505 Validation Accuracy: 0.871000 Epoch 60, CIFAR-10 Batch 5: Loss: 0.1655 Validation Accuracy: 0.879800 Epoch 60, CIFAR-10 Batch 6: Loss: 0.2830 Validation Accuracy: 0.880400 Epoch 60, CIFAR-10 Batch 7: Loss: 0.2247 Validation Accuracy: 0.869800 Epoch 60, CIFAR-10 Batch 8: Loss: 0.1960 Validation Accuracy: 0.869800 Epoch 60, CIFAR-10 Batch 9: Loss: 0.1498 Validation Accuracy: 0.877200 Epoch 60, CIFAR-10 Batch 10: Loss: 0.1368 Validation Accuracy: 0.874200 Epoch 60, CIFAR-10 Batch 11: Loss: 0.2058 Validation Accuracy: 0.877600 Epoch 60, CIFAR-10 Batch 12: Loss: 0.1823 Validation Accuracy: 0.867000 Epoch 60, CIFAR-10 Batch 13: Loss: 0.1503 Validation Accuracy: 0.874800 Epoch 60, CIFAR-10 Batch 14: Loss: 0.1718 Validation Accuracy: 0.886800 Epoch 60, CIFAR-10 Batch 15: Loss: 0.1793 Validation Accuracy: 0.880200 Epoch 60, CIFAR-10 Batch 16: Loss: 0.1699 Validation Accuracy: 0.865800 Epoch 60, CIFAR-10 Batch 17: Loss: 0.2114 Validation Accuracy: 0.873800 Epoch 60, CIFAR-10 Batch 18: Loss: 0.1476 Validation Accuracy: 0.869000 Epoch 60, CIFAR-10 Batch 19: Loss: 0.1382 Validation Accuracy: 0.880600 Epoch 60, CIFAR-10 Batch 20: Loss: 0.2016 Validation Accuracy: 0.869800 Epoch 60, CIFAR-10 Batch 21: Loss: 0.1337 Validation Accuracy: 0.877000 Epoch 60, CIFAR-10 Batch 22: Loss: 0.1725 Validation Accuracy: 0.872400 Epoch 60, CIFAR-10 Batch 23: Loss: 0.1724 Validation Accuracy: 0.871800 Epoch 60, CIFAR-10 Batch 24: Loss: 0.2091 Validation Accuracy: 0.879400 Epoch 60, CIFAR-10 Batch 25: Loss: 0.1789 Validation Accuracy: 0.871800 Epoch 60, CIFAR-10 Batch 26: Loss: 0.1951 Validation Accuracy: 0.880800 Epoch 60, CIFAR-10 Batch 27: Loss: 0.1448 Validation Accuracy: 0.871400 Epoch 60, CIFAR-10 Batch 28: Loss: 0.2954 Validation Accuracy: 0.875200 Epoch 60, CIFAR-10 Batch 29: Loss: 0.1650 Validation Accuracy: 0.886800 Epoch 60, CIFAR-10 Batch 30: Loss: 0.1421 Validation Accuracy: 0.877600 Epoch 60, CIFAR-10 Batch 31: Loss: 0.1658 Validation Accuracy: 0.868000 Epoch 60, CIFAR-10 Batch 32: Loss: 0.1496 Validation Accuracy: 0.875200 Epoch 60, CIFAR-10 Batch 33: Loss: 0.2254 Validation Accuracy: 0.865800 Epoch 60, CIFAR-10 Batch 34: Loss: 0.2258 Validation Accuracy: 0.880800 Epoch 60, CIFAR-10 Batch 35: Loss: 0.2359 Validation Accuracy: 0.873200 Epoch 60, CIFAR-10 Batch 36: Loss: 0.2584 Validation Accuracy: 0.874400 Epoch 60, CIFAR-10 Batch 37: Loss: 0.1561 Validation Accuracy: 0.860200 Epoch 60, CIFAR-10 Batch 38: Loss: 0.1332 Validation Accuracy: 0.872600 Epoch 60, CIFAR-10 Batch 39: Loss: 0.1326 Validation Accuracy: 0.874800 Epoch 60, CIFAR-10 Batch 40: Loss: 0.1776 Validation Accuracy: 0.873600 Epoch 60, CIFAR-10 Batch 41: Loss: 0.2071 Validation Accuracy: 0.882800 Epoch 60, CIFAR-10 Batch 42: Loss: 0.1600 Validation Accuracy: 0.877800 Epoch 60, CIFAR-10 Batch 43: Loss: 0.2870 Validation Accuracy: 0.883600 Epoch 60, CIFAR-10 Batch 44: Loss: 0.2137 Validation Accuracy: 0.878800 Epoch 60, CIFAR-10 Batch 45: Loss: 0.1840 Validation Accuracy: 0.878400 Epoch 60, CIFAR-10 Batch 46: Loss: 0.1567 Validation Accuracy: 0.878000 Epoch 60, CIFAR-10 Batch 47: Loss: 0.1782 Validation Accuracy: 0.882000 Epoch 60, CIFAR-10 Batch 48: Loss: 0.1528 Validation Accuracy: 0.877800 Epoch 60, CIFAR-10 Batch 49: Loss: 0.2483 Validation Accuracy: 0.873000 Epoch 60, CIFAR-10 Batch 50: Loss: 0.1602 Validation Accuracy: 0.883000 Epoch 61, CIFAR-10 Batch 1: Loss: 0.1565 Validation Accuracy: 0.870200 Epoch 61, CIFAR-10 Batch 2: Loss: 0.1499 Validation Accuracy: 0.877400 Epoch 61, CIFAR-10 Batch 3: Loss: 0.1573 Validation Accuracy: 0.872800 Epoch 61, CIFAR-10 Batch 4: Loss: 0.1512 Validation Accuracy: 0.877800 Epoch 61, CIFAR-10 Batch 5: Loss: 0.1793 Validation Accuracy: 0.879000 Epoch 61, CIFAR-10 Batch 6: Loss: 0.2802 Validation Accuracy: 0.879200 Epoch 61, CIFAR-10 Batch 7: Loss: 0.1479 Validation Accuracy: 0.879400 Epoch 61, CIFAR-10 Batch 8: Loss: 0.1808 Validation Accuracy: 0.884400 Epoch 61, CIFAR-10 Batch 9: Loss: 0.1532 Validation Accuracy: 0.880600 Epoch 61, CIFAR-10 Batch 10: Loss: 0.1400 Validation Accuracy: 0.879800 Epoch 61, CIFAR-10 Batch 11: Loss: 0.1881 Validation Accuracy: 0.874800 Epoch 61, CIFAR-10 Batch 12: Loss: 0.1742 Validation Accuracy: 0.882200 Epoch 61, CIFAR-10 Batch 13: Loss: 0.1656 Validation Accuracy: 0.869200 Epoch 61, CIFAR-10 Batch 14: Loss: 0.1679 Validation Accuracy: 0.873800 Epoch 61, CIFAR-10 Batch 15: Loss: 0.1669 Validation Accuracy: 0.871600 Epoch 61, CIFAR-10 Batch 16: Loss: 0.1732 Validation Accuracy: 0.877000 Epoch 61, CIFAR-10 Batch 17: Loss: 0.2011 Validation Accuracy: 0.884800 Epoch 61, CIFAR-10 Batch 18: Loss: 0.1455 Validation Accuracy: 0.871200 Epoch 61, CIFAR-10 Batch 19: Loss: 0.1426 Validation Accuracy: 0.871000 Epoch 61, CIFAR-10 Batch 20: Loss: 0.2142 Validation Accuracy: 0.877400 Epoch 61, CIFAR-10 Batch 21: Loss: 0.1746 Validation Accuracy: 0.872000 Epoch 61, CIFAR-10 Batch 22: Loss: 0.1693 Validation Accuracy: 0.866400 Epoch 61, CIFAR-10 Batch 23: Loss: 0.1691 Validation Accuracy: 0.868200 Epoch 61, CIFAR-10 Batch 24: Loss: 0.1985 Validation Accuracy: 0.873400 Epoch 61, CIFAR-10 Batch 25: Loss: 0.1911 Validation Accuracy: 0.873200 Epoch 61, CIFAR-10 Batch 26: Loss: 0.2051 Validation Accuracy: 0.881000 Epoch 61, CIFAR-10 Batch 27: Loss: 0.1316 Validation Accuracy: 0.870800 Epoch 61, CIFAR-10 Batch 28: Loss: 0.2337 Validation Accuracy: 0.889400 Epoch 61, CIFAR-10 Batch 29: Loss: 0.1634 Validation Accuracy: 0.876600 Epoch 61, CIFAR-10 Batch 30: Loss: 0.1292 Validation Accuracy: 0.870000 Epoch 61, CIFAR-10 Batch 31: Loss: 0.1631 Validation Accuracy: 0.874000 Epoch 61, CIFAR-10 Batch 32: Loss: 0.1520 Validation Accuracy: 0.883200 Epoch 61, CIFAR-10 Batch 33: Loss: 0.2392 Validation Accuracy: 0.873600 Epoch 61, CIFAR-10 Batch 34: Loss: 0.3142 Validation Accuracy: 0.868200 Epoch 61, CIFAR-10 Batch 35: Loss: 0.2313 Validation Accuracy: 0.877400 Epoch 61, CIFAR-10 Batch 36: Loss: 0.2482 Validation Accuracy: 0.875000 Epoch 61, CIFAR-10 Batch 37: Loss: 0.1563 Validation Accuracy: 0.875000 Epoch 61, CIFAR-10 Batch 38: Loss: 0.1339 Validation Accuracy: 0.879600 Epoch 61, CIFAR-10 Batch 39: Loss: 0.1372 Validation Accuracy: 0.888000 Epoch 61, CIFAR-10 Batch 40: Loss: 0.2031 Validation Accuracy: 0.873200 Epoch 61, CIFAR-10 Batch 41: Loss: 0.1602 Validation Accuracy: 0.870600 Epoch 61, CIFAR-10 Batch 42: Loss: 0.1638 Validation Accuracy: 0.880200 Epoch 61, CIFAR-10 Batch 43: Loss: 0.2883 Validation Accuracy: 0.874800 Epoch 61, CIFAR-10 Batch 44: Loss: 0.1756 Validation Accuracy: 0.859400 Epoch 61, CIFAR-10 Batch 45: Loss: 0.1480 Validation Accuracy: 0.885200 Epoch 61, CIFAR-10 Batch 46: Loss: 0.1765 Validation Accuracy: 0.872000 Epoch 61, CIFAR-10 Batch 47: Loss: 0.1671 Validation Accuracy: 0.884400 Epoch 61, CIFAR-10 Batch 48: Loss: 0.1747 Validation Accuracy: 0.884800 Epoch 61, CIFAR-10 Batch 49: Loss: 0.2098 Validation Accuracy: 0.883400 Epoch 61, CIFAR-10 Batch 50: Loss: 0.1592 Validation Accuracy: 0.884000 Epoch 62, CIFAR-10 Batch 1: Loss: 0.1485 Validation Accuracy: 0.878800 Epoch 62, CIFAR-10 Batch 2: Loss: 0.1554 Validation Accuracy: 0.874600 Epoch 62, CIFAR-10 Batch 3: Loss: 0.1679 Validation Accuracy: 0.868800 Epoch 62, CIFAR-10 Batch 4: Loss: 0.1592 Validation Accuracy: 0.883800 Epoch 62, CIFAR-10 Batch 5: Loss: 0.1721 Validation Accuracy: 0.882600 Epoch 62, CIFAR-10 Batch 6: Loss: 0.3025 Validation Accuracy: 0.882000 Epoch 62, CIFAR-10 Batch 7: Loss: 0.1498 Validation Accuracy: 0.862600 Epoch 62, CIFAR-10 Batch 8: Loss: 0.1924 Validation Accuracy: 0.881600 Epoch 62, CIFAR-10 Batch 9: Loss: 0.1610 Validation Accuracy: 0.888000 Epoch 62, CIFAR-10 Batch 10: Loss: 0.1477 Validation Accuracy: 0.856600 Epoch 62, CIFAR-10 Batch 11: Loss: 0.1651 Validation Accuracy: 0.878200 Epoch 62, CIFAR-10 Batch 12: Loss: 0.1733 Validation Accuracy: 0.863000 Epoch 62, CIFAR-10 Batch 13: Loss: 0.2196 Validation Accuracy: 0.886400 Epoch 62, CIFAR-10 Batch 14: Loss: 0.1764 Validation Accuracy: 0.863400 Epoch 62, CIFAR-10 Batch 15: Loss: 0.1979 Validation Accuracy: 0.877200 Epoch 62, CIFAR-10 Batch 16: Loss: 0.1576 Validation Accuracy: 0.858200 Epoch 62, CIFAR-10 Batch 17: Loss: 0.2295 Validation Accuracy: 0.879400 Epoch 62, CIFAR-10 Batch 18: Loss: 0.1620 Validation Accuracy: 0.865400 Epoch 62, CIFAR-10 Batch 19: Loss: 0.1306 Validation Accuracy: 0.877800 Epoch 62, CIFAR-10 Batch 20: Loss: 0.2414 Validation Accuracy: 0.885400 Epoch 62, CIFAR-10 Batch 21: Loss: 0.1388 Validation Accuracy: 0.881200 Epoch 62, CIFAR-10 Batch 22: Loss: 0.1930 Validation Accuracy: 0.877800 Epoch 62, CIFAR-10 Batch 23: Loss: 0.1609 Validation Accuracy: 0.874600 Epoch 62, CIFAR-10 Batch 24: Loss: 0.1775 Validation Accuracy: 0.883800 Epoch 62, CIFAR-10 Batch 25: Loss: 0.2782 Validation Accuracy: 0.882000 Epoch 62, CIFAR-10 Batch 26: Loss: 0.1594 Validation Accuracy: 0.883400 Epoch 62, CIFAR-10 Batch 27: Loss: 0.1448 Validation Accuracy: 0.871000 Epoch 62, CIFAR-10 Batch 28: Loss: 0.2478 Validation Accuracy: 0.871800 Epoch 62, CIFAR-10 Batch 29: Loss: 0.1391 Validation Accuracy: 0.874600 Epoch 62, CIFAR-10 Batch 30: Loss: 0.1314 Validation Accuracy: 0.860600 Epoch 62, CIFAR-10 Batch 31: Loss: 0.1557 Validation Accuracy: 0.881800 Epoch 62, CIFAR-10 Batch 32: Loss: 0.1549 Validation Accuracy: 0.885000 Epoch 62, CIFAR-10 Batch 33: Loss: 0.2295 Validation Accuracy: 0.874200 Epoch 62, CIFAR-10 Batch 34: Loss: 0.2663 Validation Accuracy: 0.874600 Epoch 62, CIFAR-10 Batch 35: Loss: 0.2516 Validation Accuracy: 0.873400 Epoch 62, CIFAR-10 Batch 36: Loss: 0.2538 Validation Accuracy: 0.870800 Epoch 62, CIFAR-10 Batch 37: Loss: 0.1581 Validation Accuracy: 0.867200 Epoch 62, CIFAR-10 Batch 38: Loss: 0.1320 Validation Accuracy: 0.880800 Epoch 62, CIFAR-10 Batch 39: Loss: 0.1303 Validation Accuracy: 0.870200 Epoch 62, CIFAR-10 Batch 40: Loss: 0.1818 Validation Accuracy: 0.879200 Epoch 62, CIFAR-10 Batch 41: Loss: 0.1744 Validation Accuracy: 0.875800 Epoch 62, CIFAR-10 Batch 42: Loss: 0.1668 Validation Accuracy: 0.878200 Epoch 62, CIFAR-10 Batch 43: Loss: 0.2742 Validation Accuracy: 0.883800 Epoch 62, CIFAR-10 Batch 44: Loss: 0.1766 Validation Accuracy: 0.875600 Epoch 62, CIFAR-10 Batch 45: Loss: 0.1427 Validation Accuracy: 0.886000 Epoch 62, CIFAR-10 Batch 46: Loss: 0.1640 Validation Accuracy: 0.868800 Epoch 62, CIFAR-10 Batch 47: Loss: 0.1652 Validation Accuracy: 0.885400 Epoch 62, CIFAR-10 Batch 48: Loss: 0.1473 Validation Accuracy: 0.884600 Epoch 62, CIFAR-10 Batch 49: Loss: 0.2313 Validation Accuracy: 0.870400 Epoch 62, CIFAR-10 Batch 50: Loss: 0.1675 Validation Accuracy: 0.888000 Epoch 63, CIFAR-10 Batch 1: Loss: 0.1356 Validation Accuracy: 0.881200 Epoch 63, CIFAR-10 Batch 2: Loss: 0.1948 Validation Accuracy: 0.878800 Epoch 63, CIFAR-10 Batch 3: Loss: 0.1455 Validation Accuracy: 0.889200 Epoch 63, CIFAR-10 Batch 4: Loss: 0.1606 Validation Accuracy: 0.883800 Epoch 63, CIFAR-10 Batch 5: Loss: 0.1821 Validation Accuracy: 0.881400 Epoch 63, CIFAR-10 Batch 6: Loss: 0.2625 Validation Accuracy: 0.882600 Epoch 63, CIFAR-10 Batch 7: Loss: 0.1476 Validation Accuracy: 0.863600 Epoch 63, CIFAR-10 Batch 8: Loss: 0.1890 Validation Accuracy: 0.878400 Epoch 63, CIFAR-10 Batch 9: Loss: 0.1605 Validation Accuracy: 0.882000 Epoch 63, CIFAR-10 Batch 10: Loss: 0.1368 Validation Accuracy: 0.881400 Epoch 63, CIFAR-10 Batch 11: Loss: 0.1433 Validation Accuracy: 0.879200 Epoch 63, CIFAR-10 Batch 12: Loss: 0.1592 Validation Accuracy: 0.884400 Epoch 63, CIFAR-10 Batch 13: Loss: 0.1740 Validation Accuracy: 0.885600 Epoch 63, CIFAR-10 Batch 14: Loss: 0.1785 Validation Accuracy: 0.883400 Epoch 63, CIFAR-10 Batch 15: Loss: 0.1634 Validation Accuracy: 0.877400 Epoch 63, CIFAR-10 Batch 16: Loss: 0.1498 Validation Accuracy: 0.877800 Epoch 63, CIFAR-10 Batch 17: Loss: 0.2156 Validation Accuracy: 0.878000 Epoch 63, CIFAR-10 Batch 18: Loss: 0.1524 Validation Accuracy: 0.876400 Epoch 63, CIFAR-10 Batch 19: Loss: 0.1332 Validation Accuracy: 0.876600 Epoch 63, CIFAR-10 Batch 20: Loss: 0.2320 Validation Accuracy: 0.885800 Epoch 63, CIFAR-10 Batch 21: Loss: 0.1373 Validation Accuracy: 0.889000 Epoch 63, CIFAR-10 Batch 22: Loss: 0.1949 Validation Accuracy: 0.867600 Epoch 63, CIFAR-10 Batch 23: Loss: 0.1601 Validation Accuracy: 0.882600 Epoch 63, CIFAR-10 Batch 24: Loss: 0.1801 Validation Accuracy: 0.878200 Epoch 63, CIFAR-10 Batch 25: Loss: 0.2530 Validation Accuracy: 0.866600 Epoch 63, CIFAR-10 Batch 26: Loss: 0.1598 Validation Accuracy: 0.880800 Epoch 63, CIFAR-10 Batch 27: Loss: 0.1291 Validation Accuracy: 0.874400 Epoch 63, CIFAR-10 Batch 28: Loss: 0.2737 Validation Accuracy: 0.880400 Epoch 63, CIFAR-10 Batch 29: Loss: 0.1555 Validation Accuracy: 0.877000 Epoch 63, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.872400 Epoch 63, CIFAR-10 Batch 31: Loss: 0.1605 Validation Accuracy: 0.879200 Epoch 63, CIFAR-10 Batch 32: Loss: 0.1725 Validation Accuracy: 0.874400 Epoch 63, CIFAR-10 Batch 33: Loss: 0.2339 Validation Accuracy: 0.864200 Epoch 63, CIFAR-10 Batch 34: Loss: 0.2656 Validation Accuracy: 0.869600 Epoch 63, CIFAR-10 Batch 35: Loss: 0.2490 Validation Accuracy: 0.872800 Epoch 63, CIFAR-10 Batch 36: Loss: 0.2515 Validation Accuracy: 0.859000 Epoch 63, CIFAR-10 Batch 37: Loss: 0.1491 Validation Accuracy: 0.859200 Epoch 63, CIFAR-10 Batch 38: Loss: 0.1448 Validation Accuracy: 0.883400 Epoch 63, CIFAR-10 Batch 39: Loss: 0.1360 Validation Accuracy: 0.877200 Epoch 63, CIFAR-10 Batch 40: Loss: 0.1514 Validation Accuracy: 0.868000 Epoch 63, CIFAR-10 Batch 41: Loss: 0.1789 Validation Accuracy: 0.866200 Epoch 63, CIFAR-10 Batch 42: Loss: 0.1831 Validation Accuracy: 0.873600 Epoch 63, CIFAR-10 Batch 43: Loss: 0.2883 Validation Accuracy: 0.877200 Epoch 63, CIFAR-10 Batch 44: Loss: 0.2134 Validation Accuracy: 0.874600 Epoch 63, CIFAR-10 Batch 45: Loss: 0.1427 Validation Accuracy: 0.883000 Epoch 63, CIFAR-10 Batch 46: Loss: 0.1775 Validation Accuracy: 0.878600 Epoch 63, CIFAR-10 Batch 47: Loss: 0.1727 Validation Accuracy: 0.879000 Epoch 63, CIFAR-10 Batch 48: Loss: 0.1579 Validation Accuracy: 0.855000 Epoch 63, CIFAR-10 Batch 49: Loss: 0.2136 Validation Accuracy: 0.867600 Epoch 63, CIFAR-10 Batch 50: Loss: 0.1660 Validation Accuracy: 0.884400 Epoch 64, CIFAR-10 Batch 1: Loss: 0.1565 Validation Accuracy: 0.875200 Epoch 64, CIFAR-10 Batch 2: Loss: 0.1625 Validation Accuracy: 0.878800 Epoch 64, CIFAR-10 Batch 3: Loss: 0.1371 Validation Accuracy: 0.888000 Epoch 64, CIFAR-10 Batch 4: Loss: 0.1562 Validation Accuracy: 0.882000 Epoch 64, CIFAR-10 Batch 5: Loss: 0.1654 Validation Accuracy: 0.881400 Epoch 64, CIFAR-10 Batch 6: Loss: 0.2335 Validation Accuracy: 0.883600 Epoch 64, CIFAR-10 Batch 7: Loss: 0.1403 Validation Accuracy: 0.867200 Epoch 64, CIFAR-10 Batch 8: Loss: 0.1739 Validation Accuracy: 0.879800 Epoch 64, CIFAR-10 Batch 9: Loss: 0.1442 Validation Accuracy: 0.875800 Epoch 64, CIFAR-10 Batch 10: Loss: 0.1310 Validation Accuracy: 0.879400 Epoch 64, CIFAR-10 Batch 11: Loss: 0.1430 Validation Accuracy: 0.876800 Epoch 64, CIFAR-10 Batch 12: Loss: 0.1680 Validation Accuracy: 0.865600 Epoch 64, CIFAR-10 Batch 13: Loss: 0.1602 Validation Accuracy: 0.881200 Epoch 64, CIFAR-10 Batch 14: Loss: 0.1749 Validation Accuracy: 0.879200 Epoch 64, CIFAR-10 Batch 15: Loss: 0.1628 Validation Accuracy: 0.872000 Epoch 64, CIFAR-10 Batch 16: Loss: 0.2097 Validation Accuracy: 0.869400 Epoch 64, CIFAR-10 Batch 17: Loss: 0.2060 Validation Accuracy: 0.879600 Epoch 64, CIFAR-10 Batch 18: Loss: 0.1372 Validation Accuracy: 0.874000 Epoch 64, CIFAR-10 Batch 19: Loss: 0.1411 Validation Accuracy: 0.877600 Epoch 64, CIFAR-10 Batch 20: Loss: 0.1997 Validation Accuracy: 0.883400 Epoch 64, CIFAR-10 Batch 21: Loss: 0.1803 Validation Accuracy: 0.880400 Epoch 64, CIFAR-10 Batch 22: Loss: 0.2366 Validation Accuracy: 0.878600 Epoch 64, CIFAR-10 Batch 23: Loss: 0.1652 Validation Accuracy: 0.875200 Epoch 64, CIFAR-10 Batch 24: Loss: 0.1977 Validation Accuracy: 0.891200 Epoch 64, CIFAR-10 Batch 25: Loss: 0.2293 Validation Accuracy: 0.865600 Epoch 64, CIFAR-10 Batch 26: Loss: 0.1671 Validation Accuracy: 0.869600 Epoch 64, CIFAR-10 Batch 27: Loss: 0.1255 Validation Accuracy: 0.866400 Epoch 64, CIFAR-10 Batch 28: Loss: 0.2603 Validation Accuracy: 0.880200 Epoch 64, CIFAR-10 Batch 29: Loss: 0.1532 Validation Accuracy: 0.884200 Epoch 64, CIFAR-10 Batch 30: Loss: 0.1369 Validation Accuracy: 0.871600 Epoch 64, CIFAR-10 Batch 31: Loss: 0.1499 Validation Accuracy: 0.872800 Epoch 64, CIFAR-10 Batch 32: Loss: 0.1576 Validation Accuracy: 0.880400 Epoch 64, CIFAR-10 Batch 33: Loss: 0.2386 Validation Accuracy: 0.870400 Epoch 64, CIFAR-10 Batch 34: Loss: 0.2685 Validation Accuracy: 0.878000 Epoch 64, CIFAR-10 Batch 35: Loss: 0.1918 Validation Accuracy: 0.881200 Epoch 64, CIFAR-10 Batch 36: Loss: 0.2560 Validation Accuracy: 0.872400 Epoch 64, CIFAR-10 Batch 37: Loss: 0.1460 Validation Accuracy: 0.859200 Epoch 64, CIFAR-10 Batch 38: Loss: 0.1298 Validation Accuracy: 0.878800 Epoch 64, CIFAR-10 Batch 39: Loss: 0.1362 Validation Accuracy: 0.860000 Epoch 64, CIFAR-10 Batch 40: Loss: 0.1967 Validation Accuracy: 0.852600 Epoch 64, CIFAR-10 Batch 41: Loss: 0.1608 Validation Accuracy: 0.883200 Epoch 64, CIFAR-10 Batch 42: Loss: 0.1736 Validation Accuracy: 0.882800 Epoch 64, CIFAR-10 Batch 43: Loss: 0.2280 Validation Accuracy: 0.872800 Epoch 64, CIFAR-10 Batch 44: Loss: 0.1460 Validation Accuracy: 0.884200 Epoch 64, CIFAR-10 Batch 45: Loss: 0.1594 Validation Accuracy: 0.884600 Epoch 64, CIFAR-10 Batch 46: Loss: 0.1723 Validation Accuracy: 0.888200 Epoch 64, CIFAR-10 Batch 47: Loss: 0.1827 Validation Accuracy: 0.873600 Epoch 64, CIFAR-10 Batch 48: Loss: 0.1665 Validation Accuracy: 0.881400 Epoch 64, CIFAR-10 Batch 49: Loss: 0.2381 Validation Accuracy: 0.882800 Epoch 64, CIFAR-10 Batch 50: Loss: 0.1608 Validation Accuracy: 0.878800 Epoch 65, CIFAR-10 Batch 1: Loss: 0.1503 Validation Accuracy: 0.884400 Epoch 65, CIFAR-10 Batch 2: Loss: 0.2045 Validation Accuracy: 0.879200 Epoch 65, CIFAR-10 Batch 3: Loss: 0.1400 Validation Accuracy: 0.890400 Epoch 65, CIFAR-10 Batch 4: Loss: 0.1459 Validation Accuracy: 0.884400 Epoch 65, CIFAR-10 Batch 5: Loss: 0.1680 Validation Accuracy: 0.886000 Epoch 65, CIFAR-10 Batch 6: Loss: 0.2382 Validation Accuracy: 0.875000 Epoch 65, CIFAR-10 Batch 7: Loss: 0.1546 Validation Accuracy: 0.876200 Epoch 65, CIFAR-10 Batch 8: Loss: 0.2117 Validation Accuracy: 0.882600 Epoch 65, CIFAR-10 Batch 9: Loss: 0.1544 Validation Accuracy: 0.877600 Epoch 65, CIFAR-10 Batch 10: Loss: 0.1301 Validation Accuracy: 0.877000 Epoch 65, CIFAR-10 Batch 11: Loss: 0.1683 Validation Accuracy: 0.883800 Epoch 65, CIFAR-10 Batch 12: Loss: 0.1530 Validation Accuracy: 0.886400 Epoch 65, CIFAR-10 Batch 13: Loss: 0.1531 Validation Accuracy: 0.872800 Epoch 65, CIFAR-10 Batch 14: Loss: 0.1580 Validation Accuracy: 0.880400 Epoch 65, CIFAR-10 Batch 15: Loss: 0.1506 Validation Accuracy: 0.878800 Epoch 65, CIFAR-10 Batch 16: Loss: 0.1566 Validation Accuracy: 0.881800 Epoch 65, CIFAR-10 Batch 17: Loss: 0.1961 Validation Accuracy: 0.874400 Epoch 65, CIFAR-10 Batch 18: Loss: 0.1387 Validation Accuracy: 0.878600 Epoch 65, CIFAR-10 Batch 19: Loss: 0.1463 Validation Accuracy: 0.879200 Epoch 65, CIFAR-10 Batch 20: Loss: 0.1876 Validation Accuracy: 0.885400 Epoch 65, CIFAR-10 Batch 21: Loss: 0.1484 Validation Accuracy: 0.880200 Epoch 65, CIFAR-10 Batch 22: Loss: 0.1752 Validation Accuracy: 0.879800 Epoch 65, CIFAR-10 Batch 23: Loss: 0.1688 Validation Accuracy: 0.889600 Epoch 65, CIFAR-10 Batch 24: Loss: 0.1847 Validation Accuracy: 0.888800 Epoch 65, CIFAR-10 Batch 25: Loss: 0.1801 Validation Accuracy: 0.877800 Epoch 65, CIFAR-10 Batch 26: Loss: 0.1873 Validation Accuracy: 0.884600 Epoch 65, CIFAR-10 Batch 27: Loss: 0.1287 Validation Accuracy: 0.876600 Epoch 65, CIFAR-10 Batch 28: Loss: 0.2313 Validation Accuracy: 0.874200 Epoch 65, CIFAR-10 Batch 29: Loss: 0.1633 Validation Accuracy: 0.881400 Epoch 65, CIFAR-10 Batch 30: Loss: 0.1424 Validation Accuracy: 0.879000 Epoch 65, CIFAR-10 Batch 31: Loss: 0.1558 Validation Accuracy: 0.877400 Epoch 65, CIFAR-10 Batch 32: Loss: 0.1416 Validation Accuracy: 0.872400 Epoch 65, CIFAR-10 Batch 33: Loss: 0.2895 Validation Accuracy: 0.881600 Epoch 65, CIFAR-10 Batch 34: Loss: 0.2196 Validation Accuracy: 0.866600 Epoch 65, CIFAR-10 Batch 35: Loss: 0.2696 Validation Accuracy: 0.874200 Epoch 65, CIFAR-10 Batch 36: Loss: 0.2309 Validation Accuracy: 0.857400 Epoch 65, CIFAR-10 Batch 37: Loss: 0.1650 Validation Accuracy: 0.872000 Epoch 65, CIFAR-10 Batch 38: Loss: 0.1386 Validation Accuracy: 0.867400 Epoch 65, CIFAR-10 Batch 39: Loss: 0.1367 Validation Accuracy: 0.878800 Epoch 65, CIFAR-10 Batch 40: Loss: 0.1572 Validation Accuracy: 0.872200 Epoch 65, CIFAR-10 Batch 41: Loss: 0.2001 Validation Accuracy: 0.878400 Epoch 65, CIFAR-10 Batch 42: Loss: 0.1779 Validation Accuracy: 0.871800 Epoch 65, CIFAR-10 Batch 43: Loss: 0.2813 Validation Accuracy: 0.875000 Epoch 65, CIFAR-10 Batch 44: Loss: 0.1691 Validation Accuracy: 0.860400 Epoch 65, CIFAR-10 Batch 45: Loss: 0.1817 Validation Accuracy: 0.885200 Epoch 65, CIFAR-10 Batch 46: Loss: 0.2046 Validation Accuracy: 0.874000 Epoch 65, CIFAR-10 Batch 47: Loss: 0.1566 Validation Accuracy: 0.890800 Epoch 65, CIFAR-10 Batch 48: Loss: 0.1444 Validation Accuracy: 0.882400 Epoch 65, CIFAR-10 Batch 49: Loss: 0.2180 Validation Accuracy: 0.885400 Epoch 65, CIFAR-10 Batch 50: Loss: 0.1675 Validation Accuracy: 0.882400 Epoch 66, CIFAR-10 Batch 1: Loss: 0.1525 Validation Accuracy: 0.880600 Epoch 66, CIFAR-10 Batch 2: Loss: 0.1622 Validation Accuracy: 0.875400 Epoch 66, CIFAR-10 Batch 3: Loss: 0.1345 Validation Accuracy: 0.879400 Epoch 66, CIFAR-10 Batch 4: Loss: 0.1360 Validation Accuracy: 0.881800 Epoch 66, CIFAR-10 Batch 5: Loss: 0.1876 Validation Accuracy: 0.883200 Epoch 66, CIFAR-10 Batch 6: Loss: 0.3027 Validation Accuracy: 0.887000 Epoch 66, CIFAR-10 Batch 7: Loss: 0.1450 Validation Accuracy: 0.876400 Epoch 66, CIFAR-10 Batch 8: Loss: 0.1764 Validation Accuracy: 0.893600 Epoch 66, CIFAR-10 Batch 9: Loss: 0.1708 Validation Accuracy: 0.881200 Epoch 66, CIFAR-10 Batch 10: Loss: 0.1311 Validation Accuracy: 0.890000 Epoch 66, CIFAR-10 Batch 11: Loss: 0.1657 Validation Accuracy: 0.881400 Epoch 66, CIFAR-10 Batch 12: Loss: 0.1504 Validation Accuracy: 0.872400 Epoch 66, CIFAR-10 Batch 13: Loss: 0.1789 Validation Accuracy: 0.876800 Epoch 66, CIFAR-10 Batch 14: Loss: 0.1876 Validation Accuracy: 0.866000 Epoch 66, CIFAR-10 Batch 15: Loss: 0.1464 Validation Accuracy: 0.885400 Epoch 66, CIFAR-10 Batch 16: Loss: 0.1848 Validation Accuracy: 0.864400 Epoch 66, CIFAR-10 Batch 17: Loss: 0.1854 Validation Accuracy: 0.873000 Epoch 66, CIFAR-10 Batch 18: Loss: 0.1566 Validation Accuracy: 0.861800 Epoch 66, CIFAR-10 Batch 19: Loss: 0.1402 Validation Accuracy: 0.879200 Epoch 66, CIFAR-10 Batch 20: Loss: 0.2118 Validation Accuracy: 0.888000 Epoch 66, CIFAR-10 Batch 21: Loss: 0.1308 Validation Accuracy: 0.876200 Epoch 66, CIFAR-10 Batch 22: Loss: 0.1769 Validation Accuracy: 0.878600 Epoch 66, CIFAR-10 Batch 23: Loss: 0.1629 Validation Accuracy: 0.882600 Epoch 66, CIFAR-10 Batch 24: Loss: 0.1813 Validation Accuracy: 0.883400 Epoch 66, CIFAR-10 Batch 25: Loss: 0.1741 Validation Accuracy: 0.880800 Epoch 66, CIFAR-10 Batch 26: Loss: 0.2297 Validation Accuracy: 0.886000 Epoch 66, CIFAR-10 Batch 27: Loss: 0.1335 Validation Accuracy: 0.859600 Epoch 66, CIFAR-10 Batch 28: Loss: 0.2595 Validation Accuracy: 0.881800 Epoch 66, CIFAR-10 Batch 29: Loss: 0.1534 Validation Accuracy: 0.852400 Epoch 66, CIFAR-10 Batch 30: Loss: 0.1364 Validation Accuracy: 0.879200 Epoch 66, CIFAR-10 Batch 31: Loss: 0.1360 Validation Accuracy: 0.885800 Epoch 66, CIFAR-10 Batch 32: Loss: 0.1421 Validation Accuracy: 0.877000 Epoch 66, CIFAR-10 Batch 33: Loss: 0.2434 Validation Accuracy: 0.881600 Epoch 66, CIFAR-10 Batch 34: Loss: 0.2502 Validation Accuracy: 0.879600 Epoch 66, CIFAR-10 Batch 35: Loss: 0.2899 Validation Accuracy: 0.886600 Epoch 66, CIFAR-10 Batch 36: Loss: 0.2384 Validation Accuracy: 0.869000 Epoch 66, CIFAR-10 Batch 37: Loss: 0.1671 Validation Accuracy: 0.860200 Epoch 66, CIFAR-10 Batch 38: Loss: 0.1377 Validation Accuracy: 0.869000 Epoch 66, CIFAR-10 Batch 39: Loss: 0.1346 Validation Accuracy: 0.884200 Epoch 66, CIFAR-10 Batch 40: Loss: 0.1640 Validation Accuracy: 0.863600 Epoch 66, CIFAR-10 Batch 41: Loss: 0.1581 Validation Accuracy: 0.877200 Epoch 66, CIFAR-10 Batch 42: Loss: 0.1675 Validation Accuracy: 0.870200 Epoch 66, CIFAR-10 Batch 43: Loss: 0.2436 Validation Accuracy: 0.883800 Epoch 66, CIFAR-10 Batch 44: Loss: 0.1894 Validation Accuracy: 0.851400 Epoch 66, CIFAR-10 Batch 45: Loss: 0.1345 Validation Accuracy: 0.885000 Epoch 66, CIFAR-10 Batch 46: Loss: 0.1612 Validation Accuracy: 0.878800 Epoch 66, CIFAR-10 Batch 47: Loss: 0.1565 Validation Accuracy: 0.877800 Epoch 66, CIFAR-10 Batch 48: Loss: 0.1527 Validation Accuracy: 0.882200 Epoch 66, CIFAR-10 Batch 49: Loss: 0.1750 Validation Accuracy: 0.875400 Epoch 66, CIFAR-10 Batch 50: Loss: 0.1626 Validation Accuracy: 0.886200 Epoch 67, CIFAR-10 Batch 1: Loss: 0.1636 Validation Accuracy: 0.881200 Epoch 67, CIFAR-10 Batch 2: Loss: 0.1409 Validation Accuracy: 0.879600 Epoch 67, CIFAR-10 Batch 3: Loss: 0.1467 Validation Accuracy: 0.884000 Epoch 67, CIFAR-10 Batch 4: Loss: 0.1719 Validation Accuracy: 0.870600 Epoch 67, CIFAR-10 Batch 5: Loss: 0.1646 Validation Accuracy: 0.873800 Epoch 67, CIFAR-10 Batch 6: Loss: 0.2495 Validation Accuracy: 0.879200 Epoch 67, CIFAR-10 Batch 7: Loss: 0.1421 Validation Accuracy: 0.862200 Epoch 67, CIFAR-10 Batch 8: Loss: 0.2062 Validation Accuracy: 0.875000 Epoch 67, CIFAR-10 Batch 9: Loss: 0.1626 Validation Accuracy: 0.882200 Epoch 67, CIFAR-10 Batch 10: Loss: 0.1279 Validation Accuracy: 0.868800 Epoch 67, CIFAR-10 Batch 11: Loss: 0.1608 Validation Accuracy: 0.875800 Epoch 67, CIFAR-10 Batch 12: Loss: 0.1398 Validation Accuracy: 0.889400 Epoch 67, CIFAR-10 Batch 13: Loss: 0.1796 Validation Accuracy: 0.877400 Epoch 67, CIFAR-10 Batch 14: Loss: 0.1712 Validation Accuracy: 0.870600 Epoch 67, CIFAR-10 Batch 15: Loss: 0.1730 Validation Accuracy: 0.882400 Epoch 67, CIFAR-10 Batch 16: Loss: 0.1740 Validation Accuracy: 0.874200 Epoch 67, CIFAR-10 Batch 17: Loss: 0.1905 Validation Accuracy: 0.880400 Epoch 67, CIFAR-10 Batch 18: Loss: 0.1601 Validation Accuracy: 0.867800 Epoch 67, CIFAR-10 Batch 19: Loss: 0.1342 Validation Accuracy: 0.864800 Epoch 67, CIFAR-10 Batch 20: Loss: 0.2304 Validation Accuracy: 0.879400 Epoch 67, CIFAR-10 Batch 21: Loss: 0.1421 Validation Accuracy: 0.884200 Epoch 67, CIFAR-10 Batch 22: Loss: 0.1969 Validation Accuracy: 0.875600 Epoch 67, CIFAR-10 Batch 23: Loss: 0.1878 Validation Accuracy: 0.874000 Epoch 67, CIFAR-10 Batch 24: Loss: 0.2339 Validation Accuracy: 0.862200 Epoch 67, CIFAR-10 Batch 25: Loss: 0.1835 Validation Accuracy: 0.872400 Epoch 67, CIFAR-10 Batch 26: Loss: 0.1462 Validation Accuracy: 0.881400 Epoch 67, CIFAR-10 Batch 27: Loss: 0.1303 Validation Accuracy: 0.860600 Epoch 67, CIFAR-10 Batch 28: Loss: 0.2681 Validation Accuracy: 0.871200 Epoch 67, CIFAR-10 Batch 29: Loss: 0.1480 Validation Accuracy: 0.874600 Epoch 67, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.880400 Epoch 67, CIFAR-10 Batch 31: Loss: 0.1741 Validation Accuracy: 0.865000 Epoch 67, CIFAR-10 Batch 32: Loss: 0.1396 Validation Accuracy: 0.883600 Epoch 67, CIFAR-10 Batch 33: Loss: 0.2714 Validation Accuracy: 0.853400 Epoch 67, CIFAR-10 Batch 34: Loss: 0.2616 Validation Accuracy: 0.869400 Epoch 67, CIFAR-10 Batch 35: Loss: 0.2444 Validation Accuracy: 0.879000 Epoch 67, CIFAR-10 Batch 36: Loss: 0.2353 Validation Accuracy: 0.870400 Epoch 67, CIFAR-10 Batch 37: Loss: 0.1621 Validation Accuracy: 0.880000 Epoch 67, CIFAR-10 Batch 38: Loss: 0.1366 Validation Accuracy: 0.877400 Epoch 67, CIFAR-10 Batch 39: Loss: 0.1534 Validation Accuracy: 0.880600 Epoch 67, CIFAR-10 Batch 40: Loss: 0.1561 Validation Accuracy: 0.871600 Epoch 67, CIFAR-10 Batch 41: Loss: 0.1577 Validation Accuracy: 0.876400 Epoch 67, CIFAR-10 Batch 42: Loss: 0.1959 Validation Accuracy: 0.872600 Epoch 67, CIFAR-10 Batch 43: Loss: 0.2349 Validation Accuracy: 0.875000 Epoch 67, CIFAR-10 Batch 44: Loss: 0.1375 Validation Accuracy: 0.864200 Epoch 67, CIFAR-10 Batch 45: Loss: 0.1527 Validation Accuracy: 0.870200 Epoch 67, CIFAR-10 Batch 46: Loss: 0.1667 Validation Accuracy: 0.878800 Epoch 67, CIFAR-10 Batch 47: Loss: 0.1612 Validation Accuracy: 0.875800 Epoch 67, CIFAR-10 Batch 48: Loss: 0.1579 Validation Accuracy: 0.871800 Epoch 67, CIFAR-10 Batch 49: Loss: 0.2078 Validation Accuracy: 0.873400 Epoch 67, CIFAR-10 Batch 50: Loss: 0.1636 Validation Accuracy: 0.881200 Epoch 68, CIFAR-10 Batch 1: Loss: 0.1453 Validation Accuracy: 0.873600 Epoch 68, CIFAR-10 Batch 2: Loss: 0.1384 Validation Accuracy: 0.885000 Epoch 68, CIFAR-10 Batch 3: Loss: 0.1441 Validation Accuracy: 0.880400 Epoch 68, CIFAR-10 Batch 4: Loss: 0.1553 Validation Accuracy: 0.880800 Epoch 68, CIFAR-10 Batch 5: Loss: 0.1695 Validation Accuracy: 0.878000 Epoch 68, CIFAR-10 Batch 6: Loss: 0.2704 Validation Accuracy: 0.866800 Epoch 68, CIFAR-10 Batch 7: Loss: 0.1337 Validation Accuracy: 0.873200 Epoch 68, CIFAR-10 Batch 8: Loss: 0.2395 Validation Accuracy: 0.886000 Epoch 68, CIFAR-10 Batch 9: Loss: 0.1412 Validation Accuracy: 0.869800 Epoch 68, CIFAR-10 Batch 10: Loss: 0.1350 Validation Accuracy: 0.881600 Epoch 68, CIFAR-10 Batch 11: Loss: 0.2008 Validation Accuracy: 0.876000 Epoch 68, CIFAR-10 Batch 12: Loss: 0.1621 Validation Accuracy: 0.875400 Epoch 68, CIFAR-10 Batch 13: Loss: 0.1510 Validation Accuracy: 0.885000 Epoch 68, CIFAR-10 Batch 14: Loss: 0.1697 Validation Accuracy: 0.878200 Epoch 68, CIFAR-10 Batch 15: Loss: 0.1357 Validation Accuracy: 0.884200 Epoch 68, CIFAR-10 Batch 16: Loss: 0.1583 Validation Accuracy: 0.890800 Epoch 68, CIFAR-10 Batch 17: Loss: 0.1901 Validation Accuracy: 0.873800 Epoch 68, CIFAR-10 Batch 18: Loss: 0.1608 Validation Accuracy: 0.882000 Epoch 68, CIFAR-10 Batch 19: Loss: 0.1358 Validation Accuracy: 0.886400 Epoch 68, CIFAR-10 Batch 20: Loss: 0.2049 Validation Accuracy: 0.877600 Epoch 68, CIFAR-10 Batch 21: Loss: 0.1319 Validation Accuracy: 0.874400 Epoch 68, CIFAR-10 Batch 22: Loss: 0.1706 Validation Accuracy: 0.881200 Epoch 68, CIFAR-10 Batch 23: Loss: 0.1614 Validation Accuracy: 0.883000 Epoch 68, CIFAR-10 Batch 24: Loss: 0.1587 Validation Accuracy: 0.892600 Epoch 68, CIFAR-10 Batch 25: Loss: 0.1762 Validation Accuracy: 0.876600 Epoch 68, CIFAR-10 Batch 26: Loss: 0.1579 Validation Accuracy: 0.877400 Epoch 68, CIFAR-10 Batch 27: Loss: 0.1300 Validation Accuracy: 0.877000 Epoch 68, CIFAR-10 Batch 28: Loss: 0.2431 Validation Accuracy: 0.884000 Epoch 68, CIFAR-10 Batch 29: Loss: 0.1523 Validation Accuracy: 0.874000 Epoch 68, CIFAR-10 Batch 30: Loss: 0.1278 Validation Accuracy: 0.875600 Epoch 68, CIFAR-10 Batch 31: Loss: 0.1560 Validation Accuracy: 0.879000 Epoch 68, CIFAR-10 Batch 32: Loss: 0.1536 Validation Accuracy: 0.877600 Epoch 68, CIFAR-10 Batch 33: Loss: 0.2376 Validation Accuracy: 0.874600 Epoch 68, CIFAR-10 Batch 34: Loss: 0.2538 Validation Accuracy: 0.862400 Epoch 68, CIFAR-10 Batch 35: Loss: 0.2682 Validation Accuracy: 0.884200 Epoch 68, CIFAR-10 Batch 36: Loss: 0.2415 Validation Accuracy: 0.876000 Epoch 68, CIFAR-10 Batch 37: Loss: 0.1816 Validation Accuracy: 0.876800 Epoch 68, CIFAR-10 Batch 38: Loss: 0.1482 Validation Accuracy: 0.880200 Epoch 68, CIFAR-10 Batch 39: Loss: 0.1332 Validation Accuracy: 0.883000 Epoch 68, CIFAR-10 Batch 40: Loss: 0.1434 Validation Accuracy: 0.869800 Epoch 68, CIFAR-10 Batch 41: Loss: 0.2247 Validation Accuracy: 0.881200 Epoch 68, CIFAR-10 Batch 42: Loss: 0.1702 Validation Accuracy: 0.876000 Epoch 68, CIFAR-10 Batch 43: Loss: 0.2873 Validation Accuracy: 0.875600 Epoch 68, CIFAR-10 Batch 44: Loss: 0.1779 Validation Accuracy: 0.875000 Epoch 68, CIFAR-10 Batch 45: Loss: 0.1395 Validation Accuracy: 0.882200 Epoch 68, CIFAR-10 Batch 46: Loss: 0.1655 Validation Accuracy: 0.887600 Epoch 68, CIFAR-10 Batch 47: Loss: 0.1697 Validation Accuracy: 0.879400 Epoch 68, CIFAR-10 Batch 48: Loss: 0.1415 Validation Accuracy: 0.879600 Epoch 68, CIFAR-10 Batch 49: Loss: 0.2252 Validation Accuracy: 0.875000 Epoch 68, CIFAR-10 Batch 50: Loss: 0.1385 Validation Accuracy: 0.885800 Epoch 69, CIFAR-10 Batch 1: Loss: 0.1340 Validation Accuracy: 0.877600 Epoch 69, CIFAR-10 Batch 2: Loss: 0.1396 Validation Accuracy: 0.871600 Epoch 69, CIFAR-10 Batch 3: Loss: 0.1383 Validation Accuracy: 0.888800 Epoch 69, CIFAR-10 Batch 4: Loss: 0.1475 Validation Accuracy: 0.880400 Epoch 69, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.891000 Epoch 69, CIFAR-10 Batch 6: Loss: 0.2392 Validation Accuracy: 0.892000 Epoch 69, CIFAR-10 Batch 7: Loss: 0.1404 Validation Accuracy: 0.884400 Epoch 69, CIFAR-10 Batch 8: Loss: 0.1726 Validation Accuracy: 0.889600 Epoch 69, CIFAR-10 Batch 9: Loss: 0.1405 Validation Accuracy: 0.886800 Epoch 69, CIFAR-10 Batch 10: Loss: 0.1344 Validation Accuracy: 0.874200 Epoch 69, CIFAR-10 Batch 11: Loss: 0.1355 Validation Accuracy: 0.882800 Epoch 69, CIFAR-10 Batch 12: Loss: 0.1550 Validation Accuracy: 0.883000 Epoch 69, CIFAR-10 Batch 13: Loss: 0.1467 Validation Accuracy: 0.881400 Epoch 69, CIFAR-10 Batch 14: Loss: 0.1903 Validation Accuracy: 0.883800 Epoch 69, CIFAR-10 Batch 15: Loss: 0.1905 Validation Accuracy: 0.882000 Epoch 69, CIFAR-10 Batch 16: Loss: 0.1548 Validation Accuracy: 0.872200 Epoch 69, CIFAR-10 Batch 17: Loss: 0.1982 Validation Accuracy: 0.873000 Epoch 69, CIFAR-10 Batch 18: Loss: 0.1469 Validation Accuracy: 0.873400 Epoch 69, CIFAR-10 Batch 19: Loss: 0.1431 Validation Accuracy: 0.862400 Epoch 69, CIFAR-10 Batch 20: Loss: 0.1993 Validation Accuracy: 0.866800 Epoch 69, CIFAR-10 Batch 21: Loss: 0.1407 Validation Accuracy: 0.875600 Epoch 69, CIFAR-10 Batch 22: Loss: 0.1906 Validation Accuracy: 0.883600 Epoch 69, CIFAR-10 Batch 23: Loss: 0.1669 Validation Accuracy: 0.885400 Epoch 69, CIFAR-10 Batch 24: Loss: 0.1709 Validation Accuracy: 0.886800 Epoch 69, CIFAR-10 Batch 25: Loss: 0.1970 Validation Accuracy: 0.880000 Epoch 69, CIFAR-10 Batch 26: Loss: 0.1681 Validation Accuracy: 0.880400 Epoch 69, CIFAR-10 Batch 27: Loss: 0.1257 Validation Accuracy: 0.884000 Epoch 69, CIFAR-10 Batch 28: Loss: 0.2289 Validation Accuracy: 0.885400 Epoch 69, CIFAR-10 Batch 29: Loss: 0.1461 Validation Accuracy: 0.871200 Epoch 69, CIFAR-10 Batch 30: Loss: 0.1316 Validation Accuracy: 0.876400 Epoch 69, CIFAR-10 Batch 31: Loss: 0.1471 Validation Accuracy: 0.870200 Epoch 69, CIFAR-10 Batch 32: Loss: 0.1770 Validation Accuracy: 0.886000 Epoch 69, CIFAR-10 Batch 33: Loss: 0.2093 Validation Accuracy: 0.881000 Epoch 69, CIFAR-10 Batch 34: Loss: 0.2155 Validation Accuracy: 0.879600 Epoch 69, CIFAR-10 Batch 35: Loss: 0.1778 Validation Accuracy: 0.882200 Epoch 69, CIFAR-10 Batch 36: Loss: 0.2256 Validation Accuracy: 0.870800 Epoch 69, CIFAR-10 Batch 37: Loss: 0.1480 Validation Accuracy: 0.878800 Epoch 69, CIFAR-10 Batch 38: Loss: 0.1307 Validation Accuracy: 0.877800 Epoch 69, CIFAR-10 Batch 39: Loss: 0.1396 Validation Accuracy: 0.877000 Epoch 69, CIFAR-10 Batch 40: Loss: 0.1506 Validation Accuracy: 0.873400 Epoch 69, CIFAR-10 Batch 41: Loss: 0.1727 Validation Accuracy: 0.873000 Epoch 69, CIFAR-10 Batch 42: Loss: 0.1678 Validation Accuracy: 0.878000 Epoch 69, CIFAR-10 Batch 43: Loss: 0.2204 Validation Accuracy: 0.872200 Epoch 69, CIFAR-10 Batch 44: Loss: 0.1518 Validation Accuracy: 0.887000 Epoch 69, CIFAR-10 Batch 45: Loss: 0.1432 Validation Accuracy: 0.871800 Epoch 69, CIFAR-10 Batch 46: Loss: 0.1930 Validation Accuracy: 0.867200 Epoch 69, CIFAR-10 Batch 47: Loss: 0.1662 Validation Accuracy: 0.880400 Epoch 69, CIFAR-10 Batch 48: Loss: 0.1503 Validation Accuracy: 0.882400 Epoch 69, CIFAR-10 Batch 49: Loss: 0.1877 Validation Accuracy: 0.872800 Epoch 69, CIFAR-10 Batch 50: Loss: 0.1551 Validation Accuracy: 0.860000 Epoch 70, CIFAR-10 Batch 1: Loss: 0.1481 Validation Accuracy: 0.884800 Epoch 70, CIFAR-10 Batch 2: Loss: 0.1549 Validation Accuracy: 0.881000 Epoch 70, CIFAR-10 Batch 3: Loss: 0.1442 Validation Accuracy: 0.870600 Epoch 70, CIFAR-10 Batch 4: Loss: 0.1496 Validation Accuracy: 0.882400 Epoch 70, CIFAR-10 Batch 5: Loss: 0.1539 Validation Accuracy: 0.876400 Epoch 70, CIFAR-10 Batch 6: Loss: 0.2455 Validation Accuracy: 0.881600 Epoch 70, CIFAR-10 Batch 7: Loss: 0.1514 Validation Accuracy: 0.870000 Epoch 70, CIFAR-10 Batch 8: Loss: 0.2046 Validation Accuracy: 0.880200 Epoch 70, CIFAR-10 Batch 9: Loss: 0.1794 Validation Accuracy: 0.883400 Epoch 70, CIFAR-10 Batch 10: Loss: 0.1318 Validation Accuracy: 0.875400 Epoch 70, CIFAR-10 Batch 11: Loss: 0.1529 Validation Accuracy: 0.882200 Epoch 70, CIFAR-10 Batch 12: Loss: 0.1767 Validation Accuracy: 0.866400 Epoch 70, CIFAR-10 Batch 13: Loss: 0.1633 Validation Accuracy: 0.872400 Epoch 70, CIFAR-10 Batch 14: Loss: 0.1922 Validation Accuracy: 0.883000 Epoch 70, CIFAR-10 Batch 15: Loss: 0.1504 Validation Accuracy: 0.885400 Epoch 70, CIFAR-10 Batch 16: Loss: 0.1727 Validation Accuracy: 0.882800 Epoch 70, CIFAR-10 Batch 17: Loss: 0.1578 Validation Accuracy: 0.883200 Epoch 70, CIFAR-10 Batch 18: Loss: 0.1435 Validation Accuracy: 0.867400 Epoch 70, CIFAR-10 Batch 19: Loss: 0.1575 Validation Accuracy: 0.879600 Epoch 70, CIFAR-10 Batch 20: Loss: 0.2089 Validation Accuracy: 0.859600 Epoch 70, CIFAR-10 Batch 21: Loss: 0.1399 Validation Accuracy: 0.877200 Epoch 70, CIFAR-10 Batch 22: Loss: 0.1623 Validation Accuracy: 0.867400 Epoch 70, CIFAR-10 Batch 23: Loss: 0.1556 Validation Accuracy: 0.883400 Epoch 70, CIFAR-10 Batch 24: Loss: 0.1902 Validation Accuracy: 0.881200 Epoch 70, CIFAR-10 Batch 25: Loss: 0.1940 Validation Accuracy: 0.872400 Epoch 70, CIFAR-10 Batch 26: Loss: 0.1784 Validation Accuracy: 0.879200 Epoch 70, CIFAR-10 Batch 27: Loss: 0.1309 Validation Accuracy: 0.871800 Epoch 70, CIFAR-10 Batch 28: Loss: 0.2423 Validation Accuracy: 0.878600 Epoch 70, CIFAR-10 Batch 29: Loss: 0.1778 Validation Accuracy: 0.880800 Epoch 70, CIFAR-10 Batch 30: Loss: 0.1357 Validation Accuracy: 0.879000 Epoch 70, CIFAR-10 Batch 31: Loss: 0.1448 Validation Accuracy: 0.885200 Epoch 70, CIFAR-10 Batch 32: Loss: 0.1545 Validation Accuracy: 0.877600 Epoch 70, CIFAR-10 Batch 33: Loss: 0.2431 Validation Accuracy: 0.874800 Epoch 70, CIFAR-10 Batch 34: Loss: 0.2061 Validation Accuracy: 0.892000 Epoch 70, CIFAR-10 Batch 35: Loss: 0.2391 Validation Accuracy: 0.886200 Epoch 70, CIFAR-10 Batch 36: Loss: 0.2377 Validation Accuracy: 0.879400 Epoch 70, CIFAR-10 Batch 37: Loss: 0.1314 Validation Accuracy: 0.876400 Epoch 70, CIFAR-10 Batch 38: Loss: 0.1366 Validation Accuracy: 0.884200 Epoch 70, CIFAR-10 Batch 39: Loss: 0.1309 Validation Accuracy: 0.883600 Epoch 70, CIFAR-10 Batch 40: Loss: 0.1664 Validation Accuracy: 0.876000 Epoch 70, CIFAR-10 Batch 41: Loss: 0.1591 Validation Accuracy: 0.891200 Epoch 70, CIFAR-10 Batch 42: Loss: 0.1653 Validation Accuracy: 0.872400 Epoch 70, CIFAR-10 Batch 43: Loss: 0.2067 Validation Accuracy: 0.885400 Epoch 70, CIFAR-10 Batch 44: Loss: 0.1522 Validation Accuracy: 0.859200 Epoch 70, CIFAR-10 Batch 45: Loss: 0.1393 Validation Accuracy: 0.880800 Epoch 70, CIFAR-10 Batch 46: Loss: 0.1645 Validation Accuracy: 0.888600 Epoch 70, CIFAR-10 Batch 47: Loss: 0.1649 Validation Accuracy: 0.878000 Epoch 70, CIFAR-10 Batch 48: Loss: 0.1790 Validation Accuracy: 0.888000 Epoch 70, CIFAR-10 Batch 49: Loss: 0.1908 Validation Accuracy: 0.884200 Epoch 70, CIFAR-10 Batch 50: Loss: 0.1584 Validation Accuracy: 0.873400 Epoch 71, CIFAR-10 Batch 1: Loss: 0.1590 Validation Accuracy: 0.883200 Epoch 71, CIFAR-10 Batch 2: Loss: 0.1648 Validation Accuracy: 0.879800 Epoch 71, CIFAR-10 Batch 3: Loss: 0.1397 Validation Accuracy: 0.885800 Epoch 71, CIFAR-10 Batch 4: Loss: 0.1470 Validation Accuracy: 0.874000 Epoch 71, CIFAR-10 Batch 5: Loss: 0.1696 Validation Accuracy: 0.890400 Epoch 71, CIFAR-10 Batch 6: Loss: 0.1994 Validation Accuracy: 0.889400 Epoch 71, CIFAR-10 Batch 7: Loss: 0.1589 Validation Accuracy: 0.879200 Epoch 71, CIFAR-10 Batch 8: Loss: 0.1824 Validation Accuracy: 0.880600 Epoch 71, CIFAR-10 Batch 9: Loss: 0.1501 Validation Accuracy: 0.880800 Epoch 71, CIFAR-10 Batch 10: Loss: 0.1333 Validation Accuracy: 0.874800 Epoch 71, CIFAR-10 Batch 11: Loss: 0.1410 Validation Accuracy: 0.887200 Epoch 71, CIFAR-10 Batch 12: Loss: 0.1778 Validation Accuracy: 0.887800 Epoch 71, CIFAR-10 Batch 13: Loss: 0.2108 Validation Accuracy: 0.882200 Epoch 71, CIFAR-10 Batch 14: Loss: 0.1655 Validation Accuracy: 0.873800 Epoch 71, CIFAR-10 Batch 15: Loss: 0.1446 Validation Accuracy: 0.878600 Epoch 71, CIFAR-10 Batch 16: Loss: 0.1695 Validation Accuracy: 0.856000 Epoch 71, CIFAR-10 Batch 17: Loss: 0.1766 Validation Accuracy: 0.872200 Epoch 71, CIFAR-10 Batch 18: Loss: 0.1413 Validation Accuracy: 0.878800 Epoch 71, CIFAR-10 Batch 19: Loss: 0.1469 Validation Accuracy: 0.886200 Epoch 71, CIFAR-10 Batch 20: Loss: 0.2210 Validation Accuracy: 0.876200 Epoch 71, CIFAR-10 Batch 21: Loss: 0.1340 Validation Accuracy: 0.879400 Epoch 71, CIFAR-10 Batch 22: Loss: 0.1762 Validation Accuracy: 0.859200 Epoch 71, CIFAR-10 Batch 23: Loss: 0.1391 Validation Accuracy: 0.878800 Epoch 71, CIFAR-10 Batch 24: Loss: 0.1705 Validation Accuracy: 0.883600 Epoch 71, CIFAR-10 Batch 25: Loss: 0.1696 Validation Accuracy: 0.869000 Epoch 71, CIFAR-10 Batch 26: Loss: 0.1484 Validation Accuracy: 0.880400 Epoch 71, CIFAR-10 Batch 27: Loss: 0.1261 Validation Accuracy: 0.879600 Epoch 71, CIFAR-10 Batch 28: Loss: 0.2470 Validation Accuracy: 0.874000 Epoch 71, CIFAR-10 Batch 29: Loss: 0.1658 Validation Accuracy: 0.878800 Epoch 71, CIFAR-10 Batch 30: Loss: 0.1309 Validation Accuracy: 0.877000 Epoch 71, CIFAR-10 Batch 31: Loss: 0.1363 Validation Accuracy: 0.877400 Epoch 71, CIFAR-10 Batch 32: Loss: 0.1361 Validation Accuracy: 0.888200 Epoch 71, CIFAR-10 Batch 33: Loss: 0.2449 Validation Accuracy: 0.850600 Epoch 71, CIFAR-10 Batch 34: Loss: 0.2215 Validation Accuracy: 0.878400 Epoch 71, CIFAR-10 Batch 35: Loss: 0.2056 Validation Accuracy: 0.885000 Epoch 71, CIFAR-10 Batch 36: Loss: 0.2242 Validation Accuracy: 0.886400 Epoch 71, CIFAR-10 Batch 37: Loss: 0.1735 Validation Accuracy: 0.881400 Epoch 71, CIFAR-10 Batch 38: Loss: 0.1406 Validation Accuracy: 0.868400 Epoch 71, CIFAR-10 Batch 39: Loss: 0.1413 Validation Accuracy: 0.869400 Epoch 71, CIFAR-10 Batch 40: Loss: 0.1583 Validation Accuracy: 0.865000 Epoch 71, CIFAR-10 Batch 41: Loss: 0.1702 Validation Accuracy: 0.883200 Epoch 71, CIFAR-10 Batch 42: Loss: 0.1582 Validation Accuracy: 0.885400 Epoch 71, CIFAR-10 Batch 43: Loss: 0.2461 Validation Accuracy: 0.877600 Epoch 71, CIFAR-10 Batch 44: Loss: 0.1489 Validation Accuracy: 0.877200 Epoch 71, CIFAR-10 Batch 45: Loss: 0.1494 Validation Accuracy: 0.872000 Epoch 71, CIFAR-10 Batch 46: Loss: 0.1445 Validation Accuracy: 0.878000 Epoch 71, CIFAR-10 Batch 47: Loss: 0.1582 Validation Accuracy: 0.885400 Epoch 71, CIFAR-10 Batch 48: Loss: 0.1635 Validation Accuracy: 0.884000 Epoch 71, CIFAR-10 Batch 49: Loss: 0.1761 Validation Accuracy: 0.876600 Epoch 71, CIFAR-10 Batch 50: Loss: 0.1743 Validation Accuracy: 0.884200 Epoch 72, CIFAR-10 Batch 1: Loss: 0.1813 Validation Accuracy: 0.891200 Epoch 72, CIFAR-10 Batch 2: Loss: 0.1495 Validation Accuracy: 0.867000 Epoch 72, CIFAR-10 Batch 3: Loss: 0.1407 Validation Accuracy: 0.886000 Epoch 72, CIFAR-10 Batch 4: Loss: 0.1448 Validation Accuracy: 0.870800 Epoch 72, CIFAR-10 Batch 5: Loss: 0.1622 Validation Accuracy: 0.884200 Epoch 72, CIFAR-10 Batch 6: Loss: 0.2277 Validation Accuracy: 0.887800 Epoch 72, CIFAR-10 Batch 7: Loss: 0.1358 Validation Accuracy: 0.880600 Epoch 72, CIFAR-10 Batch 8: Loss: 0.2132 Validation Accuracy: 0.882600 Epoch 72, CIFAR-10 Batch 9: Loss: 0.1619 Validation Accuracy: 0.889000 Epoch 72, CIFAR-10 Batch 10: Loss: 0.1266 Validation Accuracy: 0.876400 Epoch 72, CIFAR-10 Batch 11: Loss: 0.1381 Validation Accuracy: 0.890600 Epoch 72, CIFAR-10 Batch 12: Loss: 0.1517 Validation Accuracy: 0.876400 Epoch 72, CIFAR-10 Batch 13: Loss: 0.1549 Validation Accuracy: 0.882000 Epoch 72, CIFAR-10 Batch 14: Loss: 0.1678 Validation Accuracy: 0.881000 Epoch 72, CIFAR-10 Batch 15: Loss: 0.1921 Validation Accuracy: 0.865600 Epoch 72, CIFAR-10 Batch 16: Loss: 0.1620 Validation Accuracy: 0.877000 Epoch 72, CIFAR-10 Batch 17: Loss: 0.1840 Validation Accuracy: 0.883800 Epoch 72, CIFAR-10 Batch 18: Loss: 0.1432 Validation Accuracy: 0.891600 Epoch 72, CIFAR-10 Batch 19: Loss: 0.1399 Validation Accuracy: 0.882200 Epoch 72, CIFAR-10 Batch 20: Loss: 0.1916 Validation Accuracy: 0.875400 Epoch 72, CIFAR-10 Batch 21: Loss: 0.1459 Validation Accuracy: 0.872200 Epoch 72, CIFAR-10 Batch 22: Loss: 0.1594 Validation Accuracy: 0.866000 Epoch 72, CIFAR-10 Batch 23: Loss: 0.1604 Validation Accuracy: 0.881600 Epoch 72, CIFAR-10 Batch 24: Loss: 0.1630 Validation Accuracy: 0.886600 Epoch 72, CIFAR-10 Batch 25: Loss: 0.1734 Validation Accuracy: 0.872800 Epoch 72, CIFAR-10 Batch 26: Loss: 0.1637 Validation Accuracy: 0.886800 Epoch 72, CIFAR-10 Batch 27: Loss: 0.1304 Validation Accuracy: 0.879600 Epoch 72, CIFAR-10 Batch 28: Loss: 0.1982 Validation Accuracy: 0.882600 Epoch 72, CIFAR-10 Batch 29: Loss: 0.1946 Validation Accuracy: 0.871400 Epoch 72, CIFAR-10 Batch 30: Loss: 0.1483 Validation Accuracy: 0.874600 Epoch 72, CIFAR-10 Batch 31: Loss: 0.1429 Validation Accuracy: 0.871000 Epoch 72, CIFAR-10 Batch 32: Loss: 0.1355 Validation Accuracy: 0.863400 Epoch 72, CIFAR-10 Batch 33: Loss: 0.2081 Validation Accuracy: 0.877600 Epoch 72, CIFAR-10 Batch 34: Loss: 0.2510 Validation Accuracy: 0.870000 Epoch 72, CIFAR-10 Batch 35: Loss: 0.2020 Validation Accuracy: 0.884800 Epoch 72, CIFAR-10 Batch 36: Loss: 0.2234 Validation Accuracy: 0.872800 Epoch 72, CIFAR-10 Batch 37: Loss: 0.1668 Validation Accuracy: 0.880200 Epoch 72, CIFAR-10 Batch 38: Loss: 0.1513 Validation Accuracy: 0.883800 Epoch 72, CIFAR-10 Batch 39: Loss: 0.1678 Validation Accuracy: 0.891000 Epoch 72, CIFAR-10 Batch 40: Loss: 0.1653 Validation Accuracy: 0.877800 Epoch 72, CIFAR-10 Batch 41: Loss: 0.1640 Validation Accuracy: 0.888600 Epoch 72, CIFAR-10 Batch 42: Loss: 0.1679 Validation Accuracy: 0.879200 Epoch 72, CIFAR-10 Batch 43: Loss: 0.2123 Validation Accuracy: 0.884200 Epoch 72, CIFAR-10 Batch 44: Loss: 0.1424 Validation Accuracy: 0.870600 Epoch 72, CIFAR-10 Batch 45: Loss: 0.1635 Validation Accuracy: 0.874000 Epoch 72, CIFAR-10 Batch 46: Loss: 0.1520 Validation Accuracy: 0.875800 Epoch 72, CIFAR-10 Batch 47: Loss: 0.1604 Validation Accuracy: 0.883600 Epoch 72, CIFAR-10 Batch 48: Loss: 0.1609 Validation Accuracy: 0.880600 Epoch 72, CIFAR-10 Batch 49: Loss: 0.1759 Validation Accuracy: 0.882800 Epoch 72, CIFAR-10 Batch 50: Loss: 0.1679 Validation Accuracy: 0.877600 Epoch 73, CIFAR-10 Batch 1: Loss: 0.1586 Validation Accuracy: 0.882000 Epoch 73, CIFAR-10 Batch 2: Loss: 0.1392 Validation Accuracy: 0.877800 Epoch 73, CIFAR-10 Batch 3: Loss: 0.1299 Validation Accuracy: 0.890800 Epoch 73, CIFAR-10 Batch 4: Loss: 0.1476 Validation Accuracy: 0.872800 Epoch 73, CIFAR-10 Batch 5: Loss: 0.1476 Validation Accuracy: 0.887000 Epoch 73, CIFAR-10 Batch 6: Loss: 0.2625 Validation Accuracy: 0.882200 Epoch 73, CIFAR-10 Batch 7: Loss: 0.1734 Validation Accuracy: 0.875400 Epoch 73, CIFAR-10 Batch 8: Loss: 0.1805 Validation Accuracy: 0.878200 Epoch 73, CIFAR-10 Batch 9: Loss: 0.1502 Validation Accuracy: 0.886200 Epoch 73, CIFAR-10 Batch 10: Loss: 0.1323 Validation Accuracy: 0.885400 Epoch 73, CIFAR-10 Batch 11: Loss: 0.1508 Validation Accuracy: 0.879400 Epoch 73, CIFAR-10 Batch 12: Loss: 0.1710 Validation Accuracy: 0.889200 Epoch 73, CIFAR-10 Batch 13: Loss: 0.1987 Validation Accuracy: 0.883600 Epoch 73, CIFAR-10 Batch 14: Loss: 0.1489 Validation Accuracy: 0.876200 Epoch 73, CIFAR-10 Batch 15: Loss: 0.1493 Validation Accuracy: 0.887200 Epoch 73, CIFAR-10 Batch 16: Loss: 0.1546 Validation Accuracy: 0.871600 Epoch 73, CIFAR-10 Batch 17: Loss: 0.2335 Validation Accuracy: 0.880600 Epoch 73, CIFAR-10 Batch 18: Loss: 0.1466 Validation Accuracy: 0.870000 Epoch 73, CIFAR-10 Batch 19: Loss: 0.1378 Validation Accuracy: 0.886000 Epoch 73, CIFAR-10 Batch 20: Loss: 0.2229 Validation Accuracy: 0.881800 Epoch 73, CIFAR-10 Batch 21: Loss: 0.1342 Validation Accuracy: 0.886400 Epoch 73, CIFAR-10 Batch 22: Loss: 0.1645 Validation Accuracy: 0.885400 Epoch 73, CIFAR-10 Batch 23: Loss: 0.1465 Validation Accuracy: 0.880400 Epoch 73, CIFAR-10 Batch 24: Loss: 0.1597 Validation Accuracy: 0.880200 Epoch 73, CIFAR-10 Batch 25: Loss: 0.1718 Validation Accuracy: 0.865400 Epoch 73, CIFAR-10 Batch 26: Loss: 0.1517 Validation Accuracy: 0.883000 Epoch 73, CIFAR-10 Batch 27: Loss: 0.1332 Validation Accuracy: 0.875600 Epoch 73, CIFAR-10 Batch 28: Loss: 0.1757 Validation Accuracy: 0.885400 Epoch 73, CIFAR-10 Batch 29: Loss: 0.1585 Validation Accuracy: 0.880800 Epoch 73, CIFAR-10 Batch 30: Loss: 0.1404 Validation Accuracy: 0.872200 Epoch 73, CIFAR-10 Batch 31: Loss: 0.1480 Validation Accuracy: 0.866400 Epoch 73, CIFAR-10 Batch 32: Loss: 0.1349 Validation Accuracy: 0.875600 Epoch 73, CIFAR-10 Batch 33: Loss: 0.2078 Validation Accuracy: 0.869400 Epoch 73, CIFAR-10 Batch 34: Loss: 0.3079 Validation Accuracy: 0.878800 Epoch 73, CIFAR-10 Batch 35: Loss: 0.2002 Validation Accuracy: 0.890400 Epoch 73, CIFAR-10 Batch 36: Loss: 0.2441 Validation Accuracy: 0.885200 Epoch 73, CIFAR-10 Batch 37: Loss: 0.1725 Validation Accuracy: 0.871000 Epoch 73, CIFAR-10 Batch 38: Loss: 0.1381 Validation Accuracy: 0.875000 Epoch 73, CIFAR-10 Batch 39: Loss: 0.1361 Validation Accuracy: 0.871800 Epoch 73, CIFAR-10 Batch 40: Loss: 0.1455 Validation Accuracy: 0.856400 Epoch 73, CIFAR-10 Batch 41: Loss: 0.1489 Validation Accuracy: 0.877000 Epoch 73, CIFAR-10 Batch 42: Loss: 0.1607 Validation Accuracy: 0.868200 Epoch 73, CIFAR-10 Batch 43: Loss: 0.2405 Validation Accuracy: 0.887200 Epoch 73, CIFAR-10 Batch 44: Loss: 0.1533 Validation Accuracy: 0.874200 Epoch 73, CIFAR-10 Batch 45: Loss: 0.1406 Validation Accuracy: 0.881400 Epoch 73, CIFAR-10 Batch 46: Loss: 0.1484 Validation Accuracy: 0.856800 Epoch 73, CIFAR-10 Batch 47: Loss: 0.1836 Validation Accuracy: 0.882600 Epoch 73, CIFAR-10 Batch 48: Loss: 0.1792 Validation Accuracy: 0.882000 Epoch 73, CIFAR-10 Batch 49: Loss: 0.2414 Validation Accuracy: 0.886000 Epoch 73, CIFAR-10 Batch 50: Loss: 0.1536 Validation Accuracy: 0.873000 Epoch 74, CIFAR-10 Batch 1: Loss: 0.1481 Validation Accuracy: 0.864400 Epoch 74, CIFAR-10 Batch 2: Loss: 0.1406 Validation Accuracy: 0.884600 Epoch 74, CIFAR-10 Batch 3: Loss: 0.1317 Validation Accuracy: 0.876200 Epoch 74, CIFAR-10 Batch 4: Loss: 0.1501 Validation Accuracy: 0.877200 Epoch 74, CIFAR-10 Batch 5: Loss: 0.1588 Validation Accuracy: 0.883200 Epoch 74, CIFAR-10 Batch 6: Loss: 0.2463 Validation Accuracy: 0.877200 Epoch 74, CIFAR-10 Batch 7: Loss: 0.1366 Validation Accuracy: 0.885000 Epoch 74, CIFAR-10 Batch 8: Loss: 0.1972 Validation Accuracy: 0.880400 Epoch 74, CIFAR-10 Batch 9: Loss: 0.1472 Validation Accuracy: 0.882600 Epoch 74, CIFAR-10 Batch 10: Loss: 0.1421 Validation Accuracy: 0.882800 Epoch 74, CIFAR-10 Batch 11: Loss: 0.1574 Validation Accuracy: 0.883000 Epoch 74, CIFAR-10 Batch 12: Loss: 0.1499 Validation Accuracy: 0.882400 Epoch 74, CIFAR-10 Batch 13: Loss: 0.1763 Validation Accuracy: 0.878400 Epoch 74, CIFAR-10 Batch 14: Loss: 0.1785 Validation Accuracy: 0.885400 Epoch 74, CIFAR-10 Batch 15: Loss: 0.1595 Validation Accuracy: 0.879800 Epoch 74, CIFAR-10 Batch 16: Loss: 0.1586 Validation Accuracy: 0.870800 Epoch 74, CIFAR-10 Batch 17: Loss: 0.1948 Validation Accuracy: 0.877000 Epoch 74, CIFAR-10 Batch 18: Loss: 0.1536 Validation Accuracy: 0.866200 Epoch 74, CIFAR-10 Batch 19: Loss: 0.1402 Validation Accuracy: 0.876000 Epoch 74, CIFAR-10 Batch 20: Loss: 0.2124 Validation Accuracy: 0.881600 Epoch 74, CIFAR-10 Batch 21: Loss: 0.1293 Validation Accuracy: 0.881400 Epoch 74, CIFAR-10 Batch 22: Loss: 0.2131 Validation Accuracy: 0.883000 Epoch 74, CIFAR-10 Batch 23: Loss: 0.1614 Validation Accuracy: 0.881600 Epoch 74, CIFAR-10 Batch 24: Loss: 0.1724 Validation Accuracy: 0.886800 Epoch 74, CIFAR-10 Batch 25: Loss: 0.2181 Validation Accuracy: 0.880200 Epoch 74, CIFAR-10 Batch 26: Loss: 0.1618 Validation Accuracy: 0.883600 Epoch 74, CIFAR-10 Batch 27: Loss: 0.1305 Validation Accuracy: 0.877800 Epoch 74, CIFAR-10 Batch 28: Loss: 0.1679 Validation Accuracy: 0.877200 Epoch 74, CIFAR-10 Batch 29: Loss: 0.1401 Validation Accuracy: 0.881800 Epoch 74, CIFAR-10 Batch 30: Loss: 0.1277 Validation Accuracy: 0.874600 Epoch 74, CIFAR-10 Batch 31: Loss: 0.1318 Validation Accuracy: 0.873600 Epoch 74, CIFAR-10 Batch 32: Loss: 0.1456 Validation Accuracy: 0.872600 Epoch 74, CIFAR-10 Batch 33: Loss: 0.2346 Validation Accuracy: 0.874800 Epoch 74, CIFAR-10 Batch 34: Loss: 0.2692 Validation Accuracy: 0.881200 Epoch 74, CIFAR-10 Batch 35: Loss: 0.2318 Validation Accuracy: 0.876400 Epoch 74, CIFAR-10 Batch 36: Loss: 0.2068 Validation Accuracy: 0.874800 Epoch 74, CIFAR-10 Batch 37: Loss: 0.1719 Validation Accuracy: 0.881800 Epoch 74, CIFAR-10 Batch 38: Loss: 0.1307 Validation Accuracy: 0.876200 Epoch 74, CIFAR-10 Batch 39: Loss: 0.1374 Validation Accuracy: 0.873400 Epoch 74, CIFAR-10 Batch 40: Loss: 0.1509 Validation Accuracy: 0.876000 Epoch 74, CIFAR-10 Batch 41: Loss: 0.1515 Validation Accuracy: 0.879800 Epoch 74, CIFAR-10 Batch 42: Loss: 0.1565 Validation Accuracy: 0.876400 Epoch 74, CIFAR-10 Batch 43: Loss: 0.2393 Validation Accuracy: 0.870800 Epoch 74, CIFAR-10 Batch 44: Loss: 0.1490 Validation Accuracy: 0.877000 Epoch 74, CIFAR-10 Batch 45: Loss: 0.1497 Validation Accuracy: 0.871800 Epoch 74, CIFAR-10 Batch 46: Loss: 0.1618 Validation Accuracy: 0.874200 Epoch 74, CIFAR-10 Batch 47: Loss: 0.1581 Validation Accuracy: 0.885400 Epoch 74, CIFAR-10 Batch 48: Loss: 0.1531 Validation Accuracy: 0.872800 Epoch 74, CIFAR-10 Batch 49: Loss: 0.2211 Validation Accuracy: 0.884800 Epoch 74, CIFAR-10 Batch 50: Loss: 0.1480 Validation Accuracy: 0.881200 Epoch 75, CIFAR-10 Batch 1: Loss: 0.1620 Validation Accuracy: 0.881000 Epoch 75, CIFAR-10 Batch 2: Loss: 0.1439 Validation Accuracy: 0.876400 Epoch 75, CIFAR-10 Batch 3: Loss: 0.1555 Validation Accuracy: 0.889200 Epoch 75, CIFAR-10 Batch 4: Loss: 0.1657 Validation Accuracy: 0.875600 Epoch 75, CIFAR-10 Batch 5: Loss: 0.1444 Validation Accuracy: 0.871000 Epoch 75, CIFAR-10 Batch 6: Loss: 0.2553 Validation Accuracy: 0.877800 Epoch 75, CIFAR-10 Batch 7: Loss: 0.1332 Validation Accuracy: 0.881200 Epoch 75, CIFAR-10 Batch 8: Loss: 0.1814 Validation Accuracy: 0.877800 Epoch 75, CIFAR-10 Batch 9: Loss: 0.1562 Validation Accuracy: 0.880800 Epoch 75, CIFAR-10 Batch 10: Loss: 0.1291 Validation Accuracy: 0.885200 Epoch 75, CIFAR-10 Batch 11: Loss: 0.1596 Validation Accuracy: 0.876400 Epoch 75, CIFAR-10 Batch 12: Loss: 0.1492 Validation Accuracy: 0.865800 Epoch 75, CIFAR-10 Batch 13: Loss: 0.1610 Validation Accuracy: 0.868400 Epoch 75, CIFAR-10 Batch 14: Loss: 0.1682 Validation Accuracy: 0.865000 Epoch 75, CIFAR-10 Batch 15: Loss: 0.1740 Validation Accuracy: 0.881800 Epoch 75, CIFAR-10 Batch 16: Loss: 0.1845 Validation Accuracy: 0.883400 Epoch 75, CIFAR-10 Batch 17: Loss: 0.1735 Validation Accuracy: 0.877000 Epoch 75, CIFAR-10 Batch 18: Loss: 0.1455 Validation Accuracy: 0.867200 Epoch 75, CIFAR-10 Batch 19: Loss: 0.1389 Validation Accuracy: 0.863000 Epoch 75, CIFAR-10 Batch 20: Loss: 0.1937 Validation Accuracy: 0.879000 Epoch 75, CIFAR-10 Batch 21: Loss: 0.1300 Validation Accuracy: 0.888600 Epoch 75, CIFAR-10 Batch 22: Loss: 0.1912 Validation Accuracy: 0.860800 Epoch 75, CIFAR-10 Batch 23: Loss: 0.1404 Validation Accuracy: 0.887800 Epoch 75, CIFAR-10 Batch 24: Loss: 0.1623 Validation Accuracy: 0.883000 Epoch 75, CIFAR-10 Batch 25: Loss: 0.1837 Validation Accuracy: 0.886200 Epoch 75, CIFAR-10 Batch 26: Loss: 0.1689 Validation Accuracy: 0.878800 Epoch 75, CIFAR-10 Batch 27: Loss: 0.1254 Validation Accuracy: 0.878000 Epoch 75, CIFAR-10 Batch 28: Loss: 0.2024 Validation Accuracy: 0.876800 Epoch 75, CIFAR-10 Batch 29: Loss: 0.1561 Validation Accuracy: 0.870400 Epoch 75, CIFAR-10 Batch 30: Loss: 0.1321 Validation Accuracy: 0.882000 Epoch 75, CIFAR-10 Batch 31: Loss: 0.1344 Validation Accuracy: 0.876200 Epoch 75, CIFAR-10 Batch 32: Loss: 0.1394 Validation Accuracy: 0.871400 Epoch 75, CIFAR-10 Batch 33: Loss: 0.1989 Validation Accuracy: 0.885000 Epoch 75, CIFAR-10 Batch 34: Loss: 0.2364 Validation Accuracy: 0.875400 Epoch 75, CIFAR-10 Batch 35: Loss: 0.1835 Validation Accuracy: 0.885600 Epoch 75, CIFAR-10 Batch 36: Loss: 0.2552 Validation Accuracy: 0.881200 Epoch 75, CIFAR-10 Batch 37: Loss: 0.1422 Validation Accuracy: 0.878000 Epoch 75, CIFAR-10 Batch 38: Loss: 0.1305 Validation Accuracy: 0.873000 Epoch 75, CIFAR-10 Batch 39: Loss: 0.1369 Validation Accuracy: 0.869000 Epoch 75, CIFAR-10 Batch 40: Loss: 0.1555 Validation Accuracy: 0.878400 Epoch 75, CIFAR-10 Batch 41: Loss: 0.1689 Validation Accuracy: 0.874400 Epoch 75, CIFAR-10 Batch 42: Loss: 0.1690 Validation Accuracy: 0.881200 Epoch 75, CIFAR-10 Batch 43: Loss: 0.1958 Validation Accuracy: 0.880600 Epoch 75, CIFAR-10 Batch 44: Loss: 0.1433 Validation Accuracy: 0.885200 Epoch 75, CIFAR-10 Batch 45: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 75, CIFAR-10 Batch 46: Loss: 0.1551 Validation Accuracy: 0.879600 Epoch 75, CIFAR-10 Batch 47: Loss: 0.1610 Validation Accuracy: 0.878600 Epoch 75, CIFAR-10 Batch 48: Loss: 0.1517 Validation Accuracy: 0.881600 Epoch 75, CIFAR-10 Batch 49: Loss: 0.2195 Validation Accuracy: 0.873800 Epoch 75, CIFAR-10 Batch 50: Loss: 0.1614 Validation Accuracy: 0.880600 Epoch 76, CIFAR-10 Batch 1: Loss: 0.1408 Validation Accuracy: 0.875000 Epoch 76, CIFAR-10 Batch 2: Loss: 0.1409 Validation Accuracy: 0.880400 Epoch 76, CIFAR-10 Batch 3: Loss: 0.1358 Validation Accuracy: 0.875200 Epoch 76, CIFAR-10 Batch 4: Loss: 0.1481 Validation Accuracy: 0.883800 Epoch 76, CIFAR-10 Batch 5: Loss: 0.1944 Validation Accuracy: 0.885200 Epoch 76, CIFAR-10 Batch 6: Loss: 0.2480 Validation Accuracy: 0.892800 Epoch 76, CIFAR-10 Batch 7: Loss: 0.1930 Validation Accuracy: 0.882400 Epoch 76, CIFAR-10 Batch 8: Loss: 0.1796 Validation Accuracy: 0.873000 Epoch 76, CIFAR-10 Batch 9: Loss: 0.1461 Validation Accuracy: 0.873200 Epoch 76, CIFAR-10 Batch 10: Loss: 0.1284 Validation Accuracy: 0.882400 Epoch 76, CIFAR-10 Batch 11: Loss: 0.1604 Validation Accuracy: 0.880200 Epoch 76, CIFAR-10 Batch 12: Loss: 0.1422 Validation Accuracy: 0.880600 Epoch 76, CIFAR-10 Batch 13: Loss: 0.1675 Validation Accuracy: 0.882600 Epoch 76, CIFAR-10 Batch 14: Loss: 0.1554 Validation Accuracy: 0.873600 Epoch 76, CIFAR-10 Batch 15: Loss: 0.1542 Validation Accuracy: 0.885000 Epoch 76, CIFAR-10 Batch 16: Loss: 0.1898 Validation Accuracy: 0.876200 Epoch 76, CIFAR-10 Batch 17: Loss: 0.1811 Validation Accuracy: 0.872600 Epoch 76, CIFAR-10 Batch 18: Loss: 0.1477 Validation Accuracy: 0.865200 Epoch 76, CIFAR-10 Batch 19: Loss: 0.1491 Validation Accuracy: 0.870800 Epoch 76, CIFAR-10 Batch 20: Loss: 0.1771 Validation Accuracy: 0.883000 Epoch 76, CIFAR-10 Batch 21: Loss: 0.1326 Validation Accuracy: 0.876000 Epoch 76, CIFAR-10 Batch 22: Loss: 0.1661 Validation Accuracy: 0.891200 Epoch 76, CIFAR-10 Batch 23: Loss: 0.1757 Validation Accuracy: 0.878000 Epoch 76, CIFAR-10 Batch 24: Loss: 0.1704 Validation Accuracy: 0.886000 Epoch 76, CIFAR-10 Batch 25: Loss: 0.1709 Validation Accuracy: 0.874400 Epoch 76, CIFAR-10 Batch 26: Loss: 0.1547 Validation Accuracy: 0.883800 Epoch 76, CIFAR-10 Batch 27: Loss: 0.1349 Validation Accuracy: 0.875200 Epoch 76, CIFAR-10 Batch 28: Loss: 0.1791 Validation Accuracy: 0.880800 Epoch 76, CIFAR-10 Batch 29: Loss: 0.1380 Validation Accuracy: 0.887600 Epoch 76, CIFAR-10 Batch 30: Loss: 0.1343 Validation Accuracy: 0.874000 Epoch 76, CIFAR-10 Batch 31: Loss: 0.1438 Validation Accuracy: 0.885800 Epoch 76, CIFAR-10 Batch 32: Loss: 0.1473 Validation Accuracy: 0.880400 Epoch 76, CIFAR-10 Batch 33: Loss: 0.2191 Validation Accuracy: 0.878600 Epoch 76, CIFAR-10 Batch 34: Loss: 0.2140 Validation Accuracy: 0.878200 Epoch 76, CIFAR-10 Batch 35: Loss: 0.1945 Validation Accuracy: 0.877400 Epoch 76, CIFAR-10 Batch 36: Loss: 0.2141 Validation Accuracy: 0.881400 Epoch 76, CIFAR-10 Batch 37: Loss: 0.1478 Validation Accuracy: 0.879200 Epoch 76, CIFAR-10 Batch 38: Loss: 0.1353 Validation Accuracy: 0.878000 Epoch 76, CIFAR-10 Batch 39: Loss: 0.1346 Validation Accuracy: 0.874600 Epoch 76, CIFAR-10 Batch 40: Loss: 0.1379 Validation Accuracy: 0.885000 Epoch 76, CIFAR-10 Batch 41: Loss: 0.1485 Validation Accuracy: 0.889000 Epoch 76, CIFAR-10 Batch 42: Loss: 0.1684 Validation Accuracy: 0.879000 Epoch 76, CIFAR-10 Batch 43: Loss: 0.2383 Validation Accuracy: 0.880600 Epoch 76, CIFAR-10 Batch 44: Loss: 0.1519 Validation Accuracy: 0.876000 Epoch 76, CIFAR-10 Batch 45: Loss: 0.1409 Validation Accuracy: 0.885200 Epoch 76, CIFAR-10 Batch 46: Loss: 0.1552 Validation Accuracy: 0.884200 Epoch 76, CIFAR-10 Batch 47: Loss: 0.1505 Validation Accuracy: 0.884800 Epoch 76, CIFAR-10 Batch 48: Loss: 0.1636 Validation Accuracy: 0.877800 Epoch 76, CIFAR-10 Batch 49: Loss: 0.2021 Validation Accuracy: 0.870000 Epoch 76, CIFAR-10 Batch 50: Loss: 0.1563 Validation Accuracy: 0.886800 Epoch 77, CIFAR-10 Batch 1: Loss: 0.1565 Validation Accuracy: 0.876200 Epoch 77, CIFAR-10 Batch 2: Loss: 0.1490 Validation Accuracy: 0.886600 Epoch 77, CIFAR-10 Batch 3: Loss: 0.1420 Validation Accuracy: 0.888000 Epoch 77, CIFAR-10 Batch 4: Loss: 0.1676 Validation Accuracy: 0.884600 Epoch 77, CIFAR-10 Batch 5: Loss: 0.1844 Validation Accuracy: 0.886200 Epoch 77, CIFAR-10 Batch 6: Loss: 0.2322 Validation Accuracy: 0.883000 Epoch 77, CIFAR-10 Batch 7: Loss: 0.1550 Validation Accuracy: 0.877600 Epoch 77, CIFAR-10 Batch 8: Loss: 0.2045 Validation Accuracy: 0.859400 Epoch 77, CIFAR-10 Batch 9: Loss: 0.1759 Validation Accuracy: 0.864800 Epoch 77, CIFAR-10 Batch 10: Loss: 0.1464 Validation Accuracy: 0.883000 Epoch 77, CIFAR-10 Batch 11: Loss: 0.1488 Validation Accuracy: 0.874800 Epoch 77, CIFAR-10 Batch 12: Loss: 0.1469 Validation Accuracy: 0.882600 Epoch 77, CIFAR-10 Batch 13: Loss: 0.1757 Validation Accuracy: 0.884000 Epoch 77, CIFAR-10 Batch 14: Loss: 0.1603 Validation Accuracy: 0.872000 Epoch 77, CIFAR-10 Batch 15: Loss: 0.1513 Validation Accuracy: 0.867200 Epoch 77, CIFAR-10 Batch 16: Loss: 0.1729 Validation Accuracy: 0.885400 Epoch 77, CIFAR-10 Batch 17: Loss: 0.1641 Validation Accuracy: 0.878600 Epoch 77, CIFAR-10 Batch 18: Loss: 0.1518 Validation Accuracy: 0.862200 Epoch 77, CIFAR-10 Batch 19: Loss: 0.1317 Validation Accuracy: 0.859400 Epoch 77, CIFAR-10 Batch 20: Loss: 0.1675 Validation Accuracy: 0.875600 Epoch 77, CIFAR-10 Batch 21: Loss: 0.1498 Validation Accuracy: 0.872000 Epoch 77, CIFAR-10 Batch 22: Loss: 0.1959 Validation Accuracy: 0.873400 Epoch 77, CIFAR-10 Batch 23: Loss: 0.1549 Validation Accuracy: 0.881000 Epoch 77, CIFAR-10 Batch 24: Loss: 0.1576 Validation Accuracy: 0.875200 Epoch 77, CIFAR-10 Batch 25: Loss: 0.2004 Validation Accuracy: 0.870600 Epoch 77, CIFAR-10 Batch 26: Loss: 0.1496 Validation Accuracy: 0.881800 Epoch 77, CIFAR-10 Batch 27: Loss: 0.1272 Validation Accuracy: 0.879200 Epoch 77, CIFAR-10 Batch 28: Loss: 0.1977 Validation Accuracy: 0.883800 Epoch 77, CIFAR-10 Batch 29: Loss: 0.1483 Validation Accuracy: 0.869400 Epoch 77, CIFAR-10 Batch 30: Loss: 0.1306 Validation Accuracy: 0.878200 Epoch 77, CIFAR-10 Batch 31: Loss: 0.1361 Validation Accuracy: 0.873200 Epoch 77, CIFAR-10 Batch 32: Loss: 0.1544 Validation Accuracy: 0.880600 Epoch 77, CIFAR-10 Batch 33: Loss: 0.2123 Validation Accuracy: 0.859400 Epoch 77, CIFAR-10 Batch 34: Loss: 0.2212 Validation Accuracy: 0.871600 Epoch 77, CIFAR-10 Batch 35: Loss: 0.1873 Validation Accuracy: 0.886600 Epoch 77, CIFAR-10 Batch 36: Loss: 0.1924 Validation Accuracy: 0.870800 Epoch 77, CIFAR-10 Batch 37: Loss: 0.1517 Validation Accuracy: 0.876400 Epoch 77, CIFAR-10 Batch 38: Loss: 0.1292 Validation Accuracy: 0.890200 Epoch 77, CIFAR-10 Batch 39: Loss: 0.1351 Validation Accuracy: 0.882400 Epoch 77, CIFAR-10 Batch 40: Loss: 0.1591 Validation Accuracy: 0.870200 Epoch 77, CIFAR-10 Batch 41: Loss: 0.1457 Validation Accuracy: 0.877400 Epoch 77, CIFAR-10 Batch 42: Loss: 0.1924 Validation Accuracy: 0.869600 Epoch 77, CIFAR-10 Batch 43: Loss: 0.2528 Validation Accuracy: 0.864000 Epoch 77, CIFAR-10 Batch 44: Loss: 0.1595 Validation Accuracy: 0.875200 Epoch 77, CIFAR-10 Batch 45: Loss: 0.1313 Validation Accuracy: 0.878600 Epoch 77, CIFAR-10 Batch 46: Loss: 0.1830 Validation Accuracy: 0.859600 Epoch 77, CIFAR-10 Batch 47: Loss: 0.1583 Validation Accuracy: 0.877200 Epoch 77, CIFAR-10 Batch 48: Loss: 0.1783 Validation Accuracy: 0.881600 Epoch 77, CIFAR-10 Batch 49: Loss: 0.1949 Validation Accuracy: 0.884200 Epoch 77, CIFAR-10 Batch 50: Loss: 0.1549 Validation Accuracy: 0.877000 Epoch 78, CIFAR-10 Batch 1: Loss: 0.1517 Validation Accuracy: 0.876400 Epoch 78, CIFAR-10 Batch 2: Loss: 0.1832 Validation Accuracy: 0.880000 Epoch 78, CIFAR-10 Batch 3: Loss: 0.1366 Validation Accuracy: 0.889800 Epoch 78, CIFAR-10 Batch 4: Loss: 0.1369 Validation Accuracy: 0.876800 Epoch 78, CIFAR-10 Batch 5: Loss: 0.1548 Validation Accuracy: 0.886800 Epoch 78, CIFAR-10 Batch 6: Loss: 0.2673 Validation Accuracy: 0.888800 Epoch 78, CIFAR-10 Batch 7: Loss: 0.1395 Validation Accuracy: 0.870400 Epoch 78, CIFAR-10 Batch 8: Loss: 0.2135 Validation Accuracy: 0.880800 Epoch 78, CIFAR-10 Batch 9: Loss: 0.1441 Validation Accuracy: 0.879800 Epoch 78, CIFAR-10 Batch 10: Loss: 0.1576 Validation Accuracy: 0.886400 Epoch 78, CIFAR-10 Batch 11: Loss: 0.1384 Validation Accuracy: 0.885600 Epoch 78, CIFAR-10 Batch 12: Loss: 0.1641 Validation Accuracy: 0.881400 Epoch 78, CIFAR-10 Batch 13: Loss: 0.1763 Validation Accuracy: 0.868400 Epoch 78, CIFAR-10 Batch 14: Loss: 0.1679 Validation Accuracy: 0.886400 Epoch 78, CIFAR-10 Batch 15: Loss: 0.1525 Validation Accuracy: 0.873600 Epoch 78, CIFAR-10 Batch 16: Loss: 0.1656 Validation Accuracy: 0.874000 Epoch 78, CIFAR-10 Batch 17: Loss: 0.1577 Validation Accuracy: 0.870000 Epoch 78, CIFAR-10 Batch 18: Loss: 0.1549 Validation Accuracy: 0.866600 Epoch 78, CIFAR-10 Batch 19: Loss: 0.1311 Validation Accuracy: 0.877600 Epoch 78, CIFAR-10 Batch 20: Loss: 0.2262 Validation Accuracy: 0.876400 Epoch 78, CIFAR-10 Batch 21: Loss: 0.1366 Validation Accuracy: 0.879000 Epoch 78, CIFAR-10 Batch 22: Loss: 0.1563 Validation Accuracy: 0.881200 Epoch 78, CIFAR-10 Batch 23: Loss: 0.1561 Validation Accuracy: 0.881400 Epoch 78, CIFAR-10 Batch 24: Loss: 0.1944 Validation Accuracy: 0.886200 Epoch 78, CIFAR-10 Batch 25: Loss: 0.2210 Validation Accuracy: 0.877000 Epoch 78, CIFAR-10 Batch 26: Loss: 0.1503 Validation Accuracy: 0.873000 Epoch 78, CIFAR-10 Batch 27: Loss: 0.1270 Validation Accuracy: 0.885800 Epoch 78, CIFAR-10 Batch 28: Loss: 0.2221 Validation Accuracy: 0.871800 Epoch 78, CIFAR-10 Batch 29: Loss: 0.1333 Validation Accuracy: 0.878200 Epoch 78, CIFAR-10 Batch 30: Loss: 0.1288 Validation Accuracy: 0.874200 Epoch 78, CIFAR-10 Batch 31: Loss: 0.1561 Validation Accuracy: 0.890000 Epoch 78, CIFAR-10 Batch 32: Loss: 0.1456 Validation Accuracy: 0.875800 Epoch 78, CIFAR-10 Batch 33: Loss: 0.1839 Validation Accuracy: 0.877000 Epoch 78, CIFAR-10 Batch 34: Loss: 0.1983 Validation Accuracy: 0.872600 Epoch 78, CIFAR-10 Batch 35: Loss: 0.1800 Validation Accuracy: 0.883400 Epoch 78, CIFAR-10 Batch 36: Loss: 0.2426 Validation Accuracy: 0.886800 Epoch 78, CIFAR-10 Batch 37: Loss: 0.1511 Validation Accuracy: 0.882200 Epoch 78, CIFAR-10 Batch 38: Loss: 0.1444 Validation Accuracy: 0.867400 Epoch 78, CIFAR-10 Batch 39: Loss: 0.1382 Validation Accuracy: 0.889400 Epoch 78, CIFAR-10 Batch 40: Loss: 0.1684 Validation Accuracy: 0.861800 Epoch 78, CIFAR-10 Batch 41: Loss: 0.1357 Validation Accuracy: 0.886000 Epoch 78, CIFAR-10 Batch 42: Loss: 0.1834 Validation Accuracy: 0.881400 Epoch 78, CIFAR-10 Batch 43: Loss: 0.2421 Validation Accuracy: 0.875400 Epoch 78, CIFAR-10 Batch 44: Loss: 0.1577 Validation Accuracy: 0.868800 Epoch 78, CIFAR-10 Batch 45: Loss: 0.1641 Validation Accuracy: 0.875600 Epoch 78, CIFAR-10 Batch 46: Loss: 0.1628 Validation Accuracy: 0.886400 Epoch 78, CIFAR-10 Batch 47: Loss: 0.1543 Validation Accuracy: 0.887200 Epoch 78, CIFAR-10 Batch 48: Loss: 0.1685 Validation Accuracy: 0.866200 Epoch 78, CIFAR-10 Batch 49: Loss: 0.2066 Validation Accuracy: 0.873200 Epoch 78, CIFAR-10 Batch 50: Loss: 0.1666 Validation Accuracy: 0.884000 Epoch 79, CIFAR-10 Batch 1: Loss: 0.1399 Validation Accuracy: 0.883600 Epoch 79, CIFAR-10 Batch 2: Loss: 0.1825 Validation Accuracy: 0.879600 Epoch 79, CIFAR-10 Batch 3: Loss: 0.1384 Validation Accuracy: 0.887600 Epoch 79, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.875000 Epoch 79, CIFAR-10 Batch 5: Loss: 0.1579 Validation Accuracy: 0.877400 Epoch 79, CIFAR-10 Batch 6: Loss: 0.2729 Validation Accuracy: 0.883600 Epoch 79, CIFAR-10 Batch 7: Loss: 0.1595 Validation Accuracy: 0.871400 Epoch 79, CIFAR-10 Batch 8: Loss: 0.2020 Validation Accuracy: 0.881200 Epoch 79, CIFAR-10 Batch 9: Loss: 0.1561 Validation Accuracy: 0.879800 Epoch 79, CIFAR-10 Batch 10: Loss: 0.1317 Validation Accuracy: 0.887000 Epoch 79, CIFAR-10 Batch 11: Loss: 0.1506 Validation Accuracy: 0.882200 Epoch 79, CIFAR-10 Batch 12: Loss: 0.1436 Validation Accuracy: 0.881000 Epoch 79, CIFAR-10 Batch 13: Loss: 0.1490 Validation Accuracy: 0.879600 Epoch 79, CIFAR-10 Batch 14: Loss: 0.1812 Validation Accuracy: 0.883200 Epoch 79, CIFAR-10 Batch 15: Loss: 0.1460 Validation Accuracy: 0.881000 Epoch 79, CIFAR-10 Batch 16: Loss: 0.1539 Validation Accuracy: 0.874200 Epoch 79, CIFAR-10 Batch 17: Loss: 0.1925 Validation Accuracy: 0.873200 Epoch 79, CIFAR-10 Batch 18: Loss: 0.1392 Validation Accuracy: 0.870400 Epoch 79, CIFAR-10 Batch 19: Loss: 0.1432 Validation Accuracy: 0.879400 Epoch 79, CIFAR-10 Batch 20: Loss: 0.1863 Validation Accuracy: 0.880200 Epoch 79, CIFAR-10 Batch 21: Loss: 0.1335 Validation Accuracy: 0.878200 Epoch 79, CIFAR-10 Batch 22: Loss: 0.1806 Validation Accuracy: 0.879400 Epoch 79, CIFAR-10 Batch 23: Loss: 0.1574 Validation Accuracy: 0.861400 Epoch 79, CIFAR-10 Batch 24: Loss: 0.1672 Validation Accuracy: 0.888200 Epoch 79, CIFAR-10 Batch 25: Loss: 0.1948 Validation Accuracy: 0.866000 Epoch 79, CIFAR-10 Batch 26: Loss: 0.1672 Validation Accuracy: 0.889600 Epoch 79, CIFAR-10 Batch 27: Loss: 0.1274 Validation Accuracy: 0.883200 Epoch 79, CIFAR-10 Batch 28: Loss: 0.2049 Validation Accuracy: 0.874200 Epoch 79, CIFAR-10 Batch 29: Loss: 0.1324 Validation Accuracy: 0.890000 Epoch 79, CIFAR-10 Batch 30: Loss: 0.1346 Validation Accuracy: 0.878800 Epoch 79, CIFAR-10 Batch 31: Loss: 0.1524 Validation Accuracy: 0.880600 Epoch 79, CIFAR-10 Batch 32: Loss: 0.1460 Validation Accuracy: 0.874800 Epoch 79, CIFAR-10 Batch 33: Loss: 0.2260 Validation Accuracy: 0.870400 Epoch 79, CIFAR-10 Batch 34: Loss: 0.2144 Validation Accuracy: 0.875400 Epoch 79, CIFAR-10 Batch 35: Loss: 0.1772 Validation Accuracy: 0.888000 Epoch 79, CIFAR-10 Batch 36: Loss: 0.2316 Validation Accuracy: 0.870200 Epoch 79, CIFAR-10 Batch 37: Loss: 0.1508 Validation Accuracy: 0.881400 Epoch 79, CIFAR-10 Batch 38: Loss: 0.1449 Validation Accuracy: 0.863400 Epoch 79, CIFAR-10 Batch 39: Loss: 0.1401 Validation Accuracy: 0.871600 Epoch 79, CIFAR-10 Batch 40: Loss: 0.1476 Validation Accuracy: 0.882800 Epoch 79, CIFAR-10 Batch 41: Loss: 0.1751 Validation Accuracy: 0.880600 Epoch 79, CIFAR-10 Batch 42: Loss: 0.2037 Validation Accuracy: 0.868600 Epoch 79, CIFAR-10 Batch 43: Loss: 0.2393 Validation Accuracy: 0.868800 Epoch 79, CIFAR-10 Batch 44: Loss: 0.1576 Validation Accuracy: 0.870600 Epoch 79, CIFAR-10 Batch 45: Loss: 0.1512 Validation Accuracy: 0.884000 Epoch 79, CIFAR-10 Batch 46: Loss: 0.1528 Validation Accuracy: 0.874200 Epoch 79, CIFAR-10 Batch 47: Loss: 0.1753 Validation Accuracy: 0.883600 Epoch 79, CIFAR-10 Batch 48: Loss: 0.1712 Validation Accuracy: 0.888200 Epoch 79, CIFAR-10 Batch 49: Loss: 0.1912 Validation Accuracy: 0.883000 Epoch 79, CIFAR-10 Batch 50: Loss: 0.1566 Validation Accuracy: 0.882600 Epoch 80, CIFAR-10 Batch 1: Loss: 0.1560 Validation Accuracy: 0.886600 Epoch 80, CIFAR-10 Batch 2: Loss: 0.1345 Validation Accuracy: 0.883800 Epoch 80, CIFAR-10 Batch 3: Loss: 0.1746 Validation Accuracy: 0.882800 Epoch 80, CIFAR-10 Batch 4: Loss: 0.1500 Validation Accuracy: 0.888400 Epoch 80, CIFAR-10 Batch 5: Loss: 0.1618 Validation Accuracy: 0.879400 Epoch 80, CIFAR-10 Batch 6: Loss: 0.2303 Validation Accuracy: 0.886800 Epoch 80, CIFAR-10 Batch 7: Loss: 0.1391 Validation Accuracy: 0.867200 Epoch 80, CIFAR-10 Batch 8: Loss: 0.1730 Validation Accuracy: 0.879800 Epoch 80, CIFAR-10 Batch 9: Loss: 0.1657 Validation Accuracy: 0.877800 Epoch 80, CIFAR-10 Batch 10: Loss: 0.1374 Validation Accuracy: 0.881000 Epoch 80, CIFAR-10 Batch 11: Loss: 0.1489 Validation Accuracy: 0.879800 Epoch 80, CIFAR-10 Batch 12: Loss: 0.1573 Validation Accuracy: 0.882200 Epoch 80, CIFAR-10 Batch 13: Loss: 0.1440 Validation Accuracy: 0.884800 Epoch 80, CIFAR-10 Batch 14: Loss: 0.1684 Validation Accuracy: 0.874800 Epoch 80, CIFAR-10 Batch 15: Loss: 0.1496 Validation Accuracy: 0.890000 Epoch 80, CIFAR-10 Batch 16: Loss: 0.1773 Validation Accuracy: 0.874200 Epoch 80, CIFAR-10 Batch 17: Loss: 0.1660 Validation Accuracy: 0.883600 Epoch 80, CIFAR-10 Batch 18: Loss: 0.1496 Validation Accuracy: 0.886600 Epoch 80, CIFAR-10 Batch 19: Loss: 0.1422 Validation Accuracy: 0.878200 Epoch 80, CIFAR-10 Batch 20: Loss: 0.1929 Validation Accuracy: 0.883800 Epoch 80, CIFAR-10 Batch 21: Loss: 0.1417 Validation Accuracy: 0.872800 Epoch 80, CIFAR-10 Batch 22: Loss: 0.1651 Validation Accuracy: 0.882200 Epoch 80, CIFAR-10 Batch 23: Loss: 0.1628 Validation Accuracy: 0.884000 Epoch 80, CIFAR-10 Batch 24: Loss: 0.1411 Validation Accuracy: 0.865200 Epoch 80, CIFAR-10 Batch 25: Loss: 0.1587 Validation Accuracy: 0.857000 Epoch 80, CIFAR-10 Batch 26: Loss: 0.1635 Validation Accuracy: 0.877400 Epoch 80, CIFAR-10 Batch 27: Loss: 0.1325 Validation Accuracy: 0.864200 Epoch 80, CIFAR-10 Batch 28: Loss: 0.2284 Validation Accuracy: 0.884800 Epoch 80, CIFAR-10 Batch 29: Loss: 0.1376 Validation Accuracy: 0.878400 Epoch 80, CIFAR-10 Batch 30: Loss: 0.1374 Validation Accuracy: 0.875400 Epoch 80, CIFAR-10 Batch 31: Loss: 0.1292 Validation Accuracy: 0.884600 Epoch 80, CIFAR-10 Batch 32: Loss: 0.1453 Validation Accuracy: 0.884600 Epoch 80, CIFAR-10 Batch 33: Loss: 0.2176 Validation Accuracy: 0.879000 Epoch 80, CIFAR-10 Batch 34: Loss: 0.2199 Validation Accuracy: 0.872800 Epoch 80, CIFAR-10 Batch 35: Loss: 0.1915 Validation Accuracy: 0.882800 Epoch 80, CIFAR-10 Batch 36: Loss: 0.2226 Validation Accuracy: 0.880800 Epoch 80, CIFAR-10 Batch 37: Loss: 0.1708 Validation Accuracy: 0.875000 Epoch 80, CIFAR-10 Batch 38: Loss: 0.1367 Validation Accuracy: 0.882000 Epoch 80, CIFAR-10 Batch 39: Loss: 0.1291 Validation Accuracy: 0.877400 Epoch 80, CIFAR-10 Batch 40: Loss: 0.1603 Validation Accuracy: 0.878000 Epoch 80, CIFAR-10 Batch 41: Loss: 0.1417 Validation Accuracy: 0.882600 Epoch 80, CIFAR-10 Batch 42: Loss: 0.1661 Validation Accuracy: 0.878200 Epoch 80, CIFAR-10 Batch 43: Loss: 0.2255 Validation Accuracy: 0.875400 Epoch 80, CIFAR-10 Batch 44: Loss: 0.1689 Validation Accuracy: 0.864400 Epoch 80, CIFAR-10 Batch 45: Loss: 0.1363 Validation Accuracy: 0.873600 Epoch 80, CIFAR-10 Batch 46: Loss: 0.1628 Validation Accuracy: 0.886400 Epoch 80, CIFAR-10 Batch 47: Loss: 0.1462 Validation Accuracy: 0.882000 Epoch 80, CIFAR-10 Batch 48: Loss: 0.1748 Validation Accuracy: 0.878600 Epoch 80, CIFAR-10 Batch 49: Loss: 0.1738 Validation Accuracy: 0.874400 Epoch 80, CIFAR-10 Batch 50: Loss: 0.1673 Validation Accuracy: 0.857200 Epoch 81, CIFAR-10 Batch 1: Loss: 0.1519 Validation Accuracy: 0.875400 Epoch 81, CIFAR-10 Batch 2: Loss: 0.1362 Validation Accuracy: 0.881000 Epoch 81, CIFAR-10 Batch 3: Loss: 0.1418 Validation Accuracy: 0.881800 Epoch 81, CIFAR-10 Batch 4: Loss: 0.1331 Validation Accuracy: 0.866400 Epoch 81, CIFAR-10 Batch 5: Loss: 0.1819 Validation Accuracy: 0.882600 Epoch 81, CIFAR-10 Batch 6: Loss: 0.2291 Validation Accuracy: 0.882800 Epoch 81, CIFAR-10 Batch 7: Loss: 0.1610 Validation Accuracy: 0.874200 Epoch 81, CIFAR-10 Batch 8: Loss: 0.2023 Validation Accuracy: 0.889000 Epoch 81, CIFAR-10 Batch 9: Loss: 0.1463 Validation Accuracy: 0.882800 Epoch 81, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.880400 Epoch 81, CIFAR-10 Batch 11: Loss: 0.1571 Validation Accuracy: 0.877000 Epoch 81, CIFAR-10 Batch 12: Loss: 0.2154 Validation Accuracy: 0.874200 Epoch 81, CIFAR-10 Batch 13: Loss: 0.1560 Validation Accuracy: 0.876200 Epoch 81, CIFAR-10 Batch 14: Loss: 0.1571 Validation Accuracy: 0.875000 Epoch 81, CIFAR-10 Batch 15: Loss: 0.1392 Validation Accuracy: 0.878000 Epoch 81, CIFAR-10 Batch 16: Loss: 0.1575 Validation Accuracy: 0.874400 Epoch 81, CIFAR-10 Batch 17: Loss: 0.1782 Validation Accuracy: 0.884600 Epoch 81, CIFAR-10 Batch 18: Loss: 0.1523 Validation Accuracy: 0.873800 Epoch 81, CIFAR-10 Batch 19: Loss: 0.1299 Validation Accuracy: 0.881200 Epoch 81, CIFAR-10 Batch 20: Loss: 0.2070 Validation Accuracy: 0.883600 Epoch 81, CIFAR-10 Batch 21: Loss: 0.1505 Validation Accuracy: 0.887000 Epoch 81, CIFAR-10 Batch 22: Loss: 0.1584 Validation Accuracy: 0.876800 Epoch 81, CIFAR-10 Batch 23: Loss: 0.1469 Validation Accuracy: 0.888200 Epoch 81, CIFAR-10 Batch 24: Loss: 0.1484 Validation Accuracy: 0.883800 Epoch 81, CIFAR-10 Batch 25: Loss: 0.1953 Validation Accuracy: 0.860200 Epoch 81, CIFAR-10 Batch 26: Loss: 0.1609 Validation Accuracy: 0.882600 Epoch 81, CIFAR-10 Batch 27: Loss: 0.1315 Validation Accuracy: 0.868600 Epoch 81, CIFAR-10 Batch 28: Loss: 0.2320 Validation Accuracy: 0.883400 Epoch 81, CIFAR-10 Batch 29: Loss: 0.1398 Validation Accuracy: 0.878400 Epoch 81, CIFAR-10 Batch 30: Loss: 0.1390 Validation Accuracy: 0.884200 Epoch 81, CIFAR-10 Batch 31: Loss: 0.1586 Validation Accuracy: 0.880000 Epoch 81, CIFAR-10 Batch 32: Loss: 0.1411 Validation Accuracy: 0.880800 Epoch 81, CIFAR-10 Batch 33: Loss: 0.2079 Validation Accuracy: 0.883200 Epoch 81, CIFAR-10 Batch 34: Loss: 0.2139 Validation Accuracy: 0.874000 Epoch 81, CIFAR-10 Batch 35: Loss: 0.1933 Validation Accuracy: 0.878600 Epoch 81, CIFAR-10 Batch 36: Loss: 0.2323 Validation Accuracy: 0.865000 Epoch 81, CIFAR-10 Batch 37: Loss: 0.1587 Validation Accuracy: 0.871400 Epoch 81, CIFAR-10 Batch 38: Loss: 0.1348 Validation Accuracy: 0.881000 Epoch 81, CIFAR-10 Batch 39: Loss: 0.1291 Validation Accuracy: 0.869000 Epoch 81, CIFAR-10 Batch 40: Loss: 0.1770 Validation Accuracy: 0.870800 Epoch 81, CIFAR-10 Batch 41: Loss: 0.1550 Validation Accuracy: 0.890800 Epoch 81, CIFAR-10 Batch 42: Loss: 0.1478 Validation Accuracy: 0.866000 Epoch 81, CIFAR-10 Batch 43: Loss: 0.2417 Validation Accuracy: 0.876600 Epoch 81, CIFAR-10 Batch 44: Loss: 0.1435 Validation Accuracy: 0.885600 Epoch 81, CIFAR-10 Batch 45: Loss: 0.1388 Validation Accuracy: 0.875600 Epoch 81, CIFAR-10 Batch 46: Loss: 0.1418 Validation Accuracy: 0.881200 Epoch 81, CIFAR-10 Batch 47: Loss: 0.1699 Validation Accuracy: 0.889600 Epoch 81, CIFAR-10 Batch 48: Loss: 0.1652 Validation Accuracy: 0.886600 Epoch 81, CIFAR-10 Batch 49: Loss: 0.1849 Validation Accuracy: 0.874400 Epoch 81, CIFAR-10 Batch 50: Loss: 0.1682 Validation Accuracy: 0.887600 Epoch 82, CIFAR-10 Batch 1: Loss: 0.1964 Validation Accuracy: 0.890400 Epoch 82, CIFAR-10 Batch 2: Loss: 0.1493 Validation Accuracy: 0.893400 Epoch 82, CIFAR-10 Batch 3: Loss: 0.1385 Validation Accuracy: 0.892000 Epoch 82, CIFAR-10 Batch 4: Loss: 0.1476 Validation Accuracy: 0.895400 Epoch 82, CIFAR-10 Batch 5: Loss: 0.1985 Validation Accuracy: 0.895400 Epoch 82, CIFAR-10 Batch 6: Loss: 0.2725 Validation Accuracy: 0.899200 Epoch 82, CIFAR-10 Batch 7: Loss: 0.1790 Validation Accuracy: 0.898400 Epoch 82, CIFAR-10 Batch 8: Loss: 0.3118 Validation Accuracy: 0.899000 Epoch 82, CIFAR-10 Batch 9: Loss: 0.2199 Validation Accuracy: 0.898000 Epoch 82, CIFAR-10 Batch 10: Loss: 0.1358 Validation Accuracy: 0.896200 Epoch 82, CIFAR-10 Batch 11: Loss: 0.1516 Validation Accuracy: 0.898400 Epoch 82, CIFAR-10 Batch 12: Loss: 0.1622 Validation Accuracy: 0.897000 Epoch 82, CIFAR-10 Batch 13: Loss: 0.1626 Validation Accuracy: 0.896200 Epoch 82, CIFAR-10 Batch 14: Loss: 0.1589 Validation Accuracy: 0.902600 Epoch 82, CIFAR-10 Batch 15: Loss: 0.1382 Validation Accuracy: 0.900000 Epoch 82, CIFAR-10 Batch 16: Loss: 0.1798 Validation Accuracy: 0.898800 Epoch 82, CIFAR-10 Batch 17: Loss: 0.2171 Validation Accuracy: 0.897600 Epoch 82, CIFAR-10 Batch 18: Loss: 0.1361 Validation Accuracy: 0.898600 Epoch 82, CIFAR-10 Batch 19: Loss: 0.1443 Validation Accuracy: 0.899200 Epoch 82, CIFAR-10 Batch 20: Loss: 0.1611 Validation Accuracy: 0.900400 Epoch 82, CIFAR-10 Batch 21: Loss: 0.1505 Validation Accuracy: 0.900600 Epoch 82, CIFAR-10 Batch 22: Loss: 0.1542 Validation Accuracy: 0.901400 Epoch 82, CIFAR-10 Batch 23: Loss: 0.1374 Validation Accuracy: 0.897800 Epoch 82, CIFAR-10 Batch 24: Loss: 0.1457 Validation Accuracy: 0.901000 Epoch 82, CIFAR-10 Batch 25: Loss: 0.1735 Validation Accuracy: 0.900000 Epoch 82, CIFAR-10 Batch 26: Loss: 0.1437 Validation Accuracy: 0.901200 Epoch 82, CIFAR-10 Batch 27: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 82, CIFAR-10 Batch 28: Loss: 0.2094 Validation Accuracy: 0.900200 Epoch 82, CIFAR-10 Batch 29: Loss: 0.1530 Validation Accuracy: 0.900200 Epoch 82, CIFAR-10 Batch 30: Loss: 0.1371 Validation Accuracy: 0.900600 Epoch 82, CIFAR-10 Batch 31: Loss: 0.1346 Validation Accuracy: 0.901200 Epoch 82, CIFAR-10 Batch 32: Loss: 0.1438 Validation Accuracy: 0.901400 Epoch 82, CIFAR-10 Batch 33: Loss: 0.1758 Validation Accuracy: 0.903400 Epoch 82, CIFAR-10 Batch 34: Loss: 0.1779 Validation Accuracy: 0.902400 Epoch 82, CIFAR-10 Batch 35: Loss: 0.1688 Validation Accuracy: 0.902200 Epoch 82, CIFAR-10 Batch 36: Loss: 0.2030 Validation Accuracy: 0.897000 Epoch 82, CIFAR-10 Batch 37: Loss: 0.1435 Validation Accuracy: 0.899000 Epoch 82, CIFAR-10 Batch 38: Loss: 0.1201 Validation Accuracy: 0.896800 Epoch 82, CIFAR-10 Batch 39: Loss: 0.1268 Validation Accuracy: 0.900600 Epoch 82, CIFAR-10 Batch 40: Loss: 0.1711 Validation Accuracy: 0.899800 Epoch 82, CIFAR-10 Batch 41: Loss: 0.1320 Validation Accuracy: 0.898400 Epoch 82, CIFAR-10 Batch 42: Loss: 0.1388 Validation Accuracy: 0.899800 Epoch 82, CIFAR-10 Batch 43: Loss: 0.1532 Validation Accuracy: 0.902800 Epoch 82, CIFAR-10 Batch 44: Loss: 0.1298 Validation Accuracy: 0.900600 Epoch 82, CIFAR-10 Batch 45: Loss: 0.1232 Validation Accuracy: 0.902600 Epoch 82, CIFAR-10 Batch 46: Loss: 0.1259 Validation Accuracy: 0.898400 Epoch 82, CIFAR-10 Batch 47: Loss: 0.1441 Validation Accuracy: 0.900400 Epoch 82, CIFAR-10 Batch 48: Loss: 0.1322 Validation Accuracy: 0.899200 Epoch 82, CIFAR-10 Batch 49: Loss: 0.1602 Validation Accuracy: 0.900000 Epoch 82, CIFAR-10 Batch 50: Loss: 0.1332 Validation Accuracy: 0.899200 Epoch 83, CIFAR-10 Batch 1: Loss: 0.1372 Validation Accuracy: 0.900200 Epoch 83, CIFAR-10 Batch 2: Loss: 0.1383 Validation Accuracy: 0.899000 Epoch 83, CIFAR-10 Batch 3: Loss: 0.1232 Validation Accuracy: 0.899800 Epoch 83, CIFAR-10 Batch 4: Loss: 0.1333 Validation Accuracy: 0.900200 Epoch 83, CIFAR-10 Batch 5: Loss: 0.1780 Validation Accuracy: 0.900600 Epoch 83, CIFAR-10 Batch 6: Loss: 0.2225 Validation Accuracy: 0.900400 Epoch 83, CIFAR-10 Batch 7: Loss: 0.1895 Validation Accuracy: 0.899800 Epoch 83, CIFAR-10 Batch 8: Loss: 0.3206 Validation Accuracy: 0.901400 Epoch 83, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 83, CIFAR-10 Batch 10: Loss: 0.1274 Validation Accuracy: 0.901600 Epoch 83, CIFAR-10 Batch 11: Loss: 0.1378 Validation Accuracy: 0.902400 Epoch 83, CIFAR-10 Batch 12: Loss: 0.1366 Validation Accuracy: 0.903000 Epoch 83, CIFAR-10 Batch 13: Loss: 0.1558 Validation Accuracy: 0.903200 Epoch 83, CIFAR-10 Batch 14: Loss: 0.1413 Validation Accuracy: 0.903600 Epoch 83, CIFAR-10 Batch 15: Loss: 0.1279 Validation Accuracy: 0.903600 Epoch 83, CIFAR-10 Batch 16: Loss: 0.1585 Validation Accuracy: 0.903000 Epoch 83, CIFAR-10 Batch 17: Loss: 0.1991 Validation Accuracy: 0.903400 Epoch 83, CIFAR-10 Batch 18: Loss: 0.1334 Validation Accuracy: 0.902000 Epoch 83, CIFAR-10 Batch 19: Loss: 0.1380 Validation Accuracy: 0.903000 Epoch 83, CIFAR-10 Batch 20: Loss: 0.1548 Validation Accuracy: 0.902200 Epoch 83, CIFAR-10 Batch 21: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 83, CIFAR-10 Batch 22: Loss: 0.1556 Validation Accuracy: 0.903000 Epoch 83, CIFAR-10 Batch 23: Loss: 0.1290 Validation Accuracy: 0.902800 Epoch 83, CIFAR-10 Batch 24: Loss: 0.1345 Validation Accuracy: 0.902800 Epoch 83, CIFAR-10 Batch 25: Loss: 0.1562 Validation Accuracy: 0.902400 Epoch 83, CIFAR-10 Batch 26: Loss: 0.1328 Validation Accuracy: 0.903400 Epoch 83, CIFAR-10 Batch 27: Loss: 0.1166 Validation Accuracy: 0.902600 Epoch 83, CIFAR-10 Batch 28: Loss: 0.1936 Validation Accuracy: 0.902600 Epoch 83, CIFAR-10 Batch 29: Loss: 0.1487 Validation Accuracy: 0.902200 Epoch 83, CIFAR-10 Batch 30: Loss: 0.1382 Validation Accuracy: 0.903000 Epoch 83, CIFAR-10 Batch 31: Loss: 0.1318 Validation Accuracy: 0.902600 Epoch 83, CIFAR-10 Batch 32: Loss: 0.1379 Validation Accuracy: 0.901800 Epoch 83, CIFAR-10 Batch 33: Loss: 0.1619 Validation Accuracy: 0.902800 Epoch 83, CIFAR-10 Batch 34: Loss: 0.1626 Validation Accuracy: 0.902000 Epoch 83, CIFAR-10 Batch 35: Loss: 0.1631 Validation Accuracy: 0.901200 Epoch 83, CIFAR-10 Batch 36: Loss: 0.1979 Validation Accuracy: 0.901200 Epoch 83, CIFAR-10 Batch 37: Loss: 0.1422 Validation Accuracy: 0.901600 Epoch 83, CIFAR-10 Batch 38: Loss: 0.1185 Validation Accuracy: 0.900800 Epoch 83, CIFAR-10 Batch 39: Loss: 0.1224 Validation Accuracy: 0.901800 Epoch 83, CIFAR-10 Batch 40: Loss: 0.1513 Validation Accuracy: 0.901200 Epoch 83, CIFAR-10 Batch 41: Loss: 0.1260 Validation Accuracy: 0.902200 Epoch 83, CIFAR-10 Batch 42: Loss: 0.1394 Validation Accuracy: 0.901200 Epoch 83, CIFAR-10 Batch 43: Loss: 0.1473 Validation Accuracy: 0.901600 Epoch 83, CIFAR-10 Batch 44: Loss: 0.1225 Validation Accuracy: 0.901600 Epoch 83, CIFAR-10 Batch 45: Loss: 0.1174 Validation Accuracy: 0.901200 Epoch 83, CIFAR-10 Batch 46: Loss: 0.1220 Validation Accuracy: 0.901600 Epoch 83, CIFAR-10 Batch 47: Loss: 0.1320 Validation Accuracy: 0.902600 Epoch 83, CIFAR-10 Batch 48: Loss: 0.1284 Validation Accuracy: 0.902400 Epoch 83, CIFAR-10 Batch 49: Loss: 0.1551 Validation Accuracy: 0.900800 Epoch 83, CIFAR-10 Batch 50: Loss: 0.1347 Validation Accuracy: 0.902200 Epoch 84, CIFAR-10 Batch 1: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 84, CIFAR-10 Batch 2: Loss: 0.1385 Validation Accuracy: 0.901800 Epoch 84, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902600 Epoch 84, CIFAR-10 Batch 4: Loss: 0.1316 Validation Accuracy: 0.902000 Epoch 84, CIFAR-10 Batch 5: Loss: 0.1686 Validation Accuracy: 0.902000 Epoch 84, CIFAR-10 Batch 6: Loss: 0.2176 Validation Accuracy: 0.901600 Epoch 84, CIFAR-10 Batch 7: Loss: 0.1841 Validation Accuracy: 0.902000 Epoch 84, CIFAR-10 Batch 8: Loss: 0.2933 Validation Accuracy: 0.901400 Epoch 84, CIFAR-10 Batch 9: Loss: 0.1799 Validation Accuracy: 0.901800 Epoch 84, CIFAR-10 Batch 10: Loss: 0.1266 Validation Accuracy: 0.901400 Epoch 84, CIFAR-10 Batch 11: Loss: 0.1342 Validation Accuracy: 0.902200 Epoch 84, CIFAR-10 Batch 12: Loss: 0.1336 Validation Accuracy: 0.902400 Epoch 84, CIFAR-10 Batch 13: Loss: 0.1473 Validation Accuracy: 0.902800 Epoch 84, CIFAR-10 Batch 14: Loss: 0.1401 Validation Accuracy: 0.902800 Epoch 84, CIFAR-10 Batch 15: Loss: 0.1270 Validation Accuracy: 0.902400 Epoch 84, CIFAR-10 Batch 16: Loss: 0.1540 Validation Accuracy: 0.902400 Epoch 84, CIFAR-10 Batch 17: Loss: 0.1921 Validation Accuracy: 0.902800 Epoch 84, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 84, CIFAR-10 Batch 19: Loss: 0.1370 Validation Accuracy: 0.901400 Epoch 84, CIFAR-10 Batch 20: Loss: 0.1541 Validation Accuracy: 0.902800 Epoch 84, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902800 Epoch 84, CIFAR-10 Batch 22: Loss: 0.1504 Validation Accuracy: 0.903200 Epoch 84, CIFAR-10 Batch 23: Loss: 0.1274 Validation Accuracy: 0.903400 Epoch 84, CIFAR-10 Batch 24: Loss: 0.1350 Validation Accuracy: 0.902800 Epoch 84, CIFAR-10 Batch 25: Loss: 0.1542 Validation Accuracy: 0.903200 Epoch 84, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903400 Epoch 84, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 84, CIFAR-10 Batch 28: Loss: 0.1922 Validation Accuracy: 0.902000 Epoch 84, CIFAR-10 Batch 29: Loss: 0.1495 Validation Accuracy: 0.902200 Epoch 84, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903400 Epoch 84, CIFAR-10 Batch 31: Loss: 0.1317 Validation Accuracy: 0.902200 Epoch 84, CIFAR-10 Batch 32: Loss: 0.1341 Validation Accuracy: 0.902200 Epoch 84, CIFAR-10 Batch 33: Loss: 0.1610 Validation Accuracy: 0.901800 Epoch 84, CIFAR-10 Batch 34: Loss: 0.1597 Validation Accuracy: 0.902000 Epoch 84, CIFAR-10 Batch 35: Loss: 0.1596 Validation Accuracy: 0.901800 Epoch 84, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902200 Epoch 84, CIFAR-10 Batch 37: Loss: 0.1433 Validation Accuracy: 0.902200 Epoch 84, CIFAR-10 Batch 38: Loss: 0.1180 Validation Accuracy: 0.901200 Epoch 84, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 84, CIFAR-10 Batch 40: Loss: 0.1518 Validation Accuracy: 0.902000 Epoch 84, CIFAR-10 Batch 41: Loss: 0.1251 Validation Accuracy: 0.902200 Epoch 84, CIFAR-10 Batch 42: Loss: 0.1386 Validation Accuracy: 0.902400 Epoch 84, CIFAR-10 Batch 43: Loss: 0.1435 Validation Accuracy: 0.902600 Epoch 84, CIFAR-10 Batch 44: Loss: 0.1219 Validation Accuracy: 0.903000 Epoch 84, CIFAR-10 Batch 45: Loss: 0.1172 Validation Accuracy: 0.903200 Epoch 84, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 84, CIFAR-10 Batch 47: Loss: 0.1313 Validation Accuracy: 0.902400 Epoch 84, CIFAR-10 Batch 48: Loss: 0.1284 Validation Accuracy: 0.901600 Epoch 84, CIFAR-10 Batch 49: Loss: 0.1551 Validation Accuracy: 0.901600 Epoch 84, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 85, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901400 Epoch 85, CIFAR-10 Batch 2: Loss: 0.1383 Validation Accuracy: 0.901400 Epoch 85, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 85, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 85, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.902000 Epoch 85, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 85, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 85, CIFAR-10 Batch 8: Loss: 0.2929 Validation Accuracy: 0.901600 Epoch 85, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901400 Epoch 85, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901400 Epoch 85, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901600 Epoch 85, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 85, CIFAR-10 Batch 13: Loss: 0.1467 Validation Accuracy: 0.901600 Epoch 85, CIFAR-10 Batch 14: Loss: 0.1397 Validation Accuracy: 0.902600 Epoch 85, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902400 Epoch 85, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 85, CIFAR-10 Batch 17: Loss: 0.1911 Validation Accuracy: 0.902800 Epoch 85, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 85, CIFAR-10 Batch 19: Loss: 0.1366 Validation Accuracy: 0.902000 Epoch 85, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902800 Epoch 85, CIFAR-10 Batch 21: Loss: 0.1321 Validation Accuracy: 0.902600 Epoch 85, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 85, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 85, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 85, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 85, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 85, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903200 Epoch 85, CIFAR-10 Batch 28: Loss: 0.1922 Validation Accuracy: 0.902200 Epoch 85, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902200 Epoch 85, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 85, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 85, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902400 Epoch 85, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.901800 Epoch 85, CIFAR-10 Batch 34: Loss: 0.1593 Validation Accuracy: 0.901600 Epoch 85, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 85, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 85, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902200 Epoch 85, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 85, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 85, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 85, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 85, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 85, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 85, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 85, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 85, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 85, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 85, CIFAR-10 Batch 48: Loss: 0.1284 Validation Accuracy: 0.901400 Epoch 85, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 85, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 86, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 86, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 86, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 86, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 86, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 86, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 86, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901800 Epoch 86, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.902000 Epoch 86, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901400 Epoch 86, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 86, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 86, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902000 Epoch 86, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 86, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902800 Epoch 86, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903000 Epoch 86, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 86, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902800 Epoch 86, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 86, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 86, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 86, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 86, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 86, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 86, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 86, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903000 Epoch 86, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 86, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902400 Epoch 86, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901800 Epoch 86, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 86, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 86, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 86, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 86, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902000 Epoch 86, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901600 Epoch 86, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 86, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902200 Epoch 86, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902200 Epoch 86, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 86, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 86, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 86, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 86, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 86, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 86, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 86, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 86, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 86, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 86, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901600 Epoch 86, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 86, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 87, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 87, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 87, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 87, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 87, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 87, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901400 Epoch 87, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 87, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 87, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901400 Epoch 87, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 87, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 87, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902000 Epoch 87, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.901800 Epoch 87, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 87, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 87, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 87, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902200 Epoch 87, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 87, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902200 Epoch 87, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902200 Epoch 87, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 87, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 87, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 87, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 87, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 87, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 87, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903200 Epoch 87, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902400 Epoch 87, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 87, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 87, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902000 Epoch 87, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 87, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 87, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901800 Epoch 87, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901400 Epoch 87, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 87, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902800 Epoch 87, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 87, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 87, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 87, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 87, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902600 Epoch 87, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 87, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 87, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 87, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 87, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 87, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 87, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 87, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 88, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 88, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 88, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 88, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901600 Epoch 88, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 88, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 88, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 88, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901000 Epoch 88, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 88, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.902000 Epoch 88, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 88, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902400 Epoch 88, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 88, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902800 Epoch 88, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 88, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 88, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 88, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 88, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902200 Epoch 88, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902800 Epoch 88, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 88, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.903000 Epoch 88, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 88, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 88, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 88, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 88, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 88, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 88, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901600 Epoch 88, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 88, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902000 Epoch 88, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 88, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902000 Epoch 88, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902000 Epoch 88, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 88, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902200 Epoch 88, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 88, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 88, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 88, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 88, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 88, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 88, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 88, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902600 Epoch 88, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903400 Epoch 88, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 88, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 88, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901600 Epoch 88, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 88, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902200 Epoch 89, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 89, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 89, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 89, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901600 Epoch 89, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.902000 Epoch 89, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 89, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 89, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901800 Epoch 89, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 89, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 89, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 89, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 89, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 89, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903200 Epoch 89, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902400 Epoch 89, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 89, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902800 Epoch 89, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 89, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 89, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 89, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902800 Epoch 89, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 89, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903600 Epoch 89, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 89, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903000 Epoch 89, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903600 Epoch 89, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902400 Epoch 89, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 89, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 89, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903200 Epoch 89, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 89, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 89, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902400 Epoch 89, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901600 Epoch 89, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901600 Epoch 89, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 89, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 89, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 89, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 89, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 89, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 89, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 89, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 89, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 89, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 89, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 89, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 89, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.902000 Epoch 89, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901400 Epoch 89, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 90, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 90, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 90, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 90, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 90, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 90, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 90, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 90, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 90, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 90, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901200 Epoch 90, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 90, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902000 Epoch 90, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.901800 Epoch 90, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 90, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 90, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 90, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 90, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 90, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 90, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 90, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 90, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 90, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 90, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 90, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903000 Epoch 90, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 90, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 90, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 90, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901600 Epoch 90, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902600 Epoch 90, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 90, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 90, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902400 Epoch 90, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902000 Epoch 90, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 90, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 90, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 90, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 90, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 90, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 90, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901400 Epoch 90, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902400 Epoch 90, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902400 Epoch 90, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 90, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 90, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 90, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902600 Epoch 90, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 90, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 90, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 91, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 91, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901600 Epoch 91, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.901800 Epoch 91, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901000 Epoch 91, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 91, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 91, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 91, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 91, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901400 Epoch 91, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.902000 Epoch 91, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 91, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902000 Epoch 91, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902600 Epoch 91, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902400 Epoch 91, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903000 Epoch 91, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 91, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 91, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902800 Epoch 91, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902200 Epoch 91, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 91, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 91, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.903000 Epoch 91, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903600 Epoch 91, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.903200 Epoch 91, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 91, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 91, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 91, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 91, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 91, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 91, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 91, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901600 Epoch 91, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 91, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902000 Epoch 91, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 91, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902200 Epoch 91, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902800 Epoch 91, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.902000 Epoch 91, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 91, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902600 Epoch 91, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 91, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 91, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.903000 Epoch 91, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902600 Epoch 91, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 91, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 91, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 91, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 91, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 91, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 92, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 92, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 92, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 92, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 92, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 92, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 92, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 92, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 92, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 92, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 92, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 92, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902000 Epoch 92, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 92, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 92, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903000 Epoch 92, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 92, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 92, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 92, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 92, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902800 Epoch 92, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 92, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 92, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.902800 Epoch 92, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 92, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 92, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 92, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 92, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 92, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 92, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 92, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 92, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901800 Epoch 92, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902800 Epoch 92, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902000 Epoch 92, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 92, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 92, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 92, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.902000 Epoch 92, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 92, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 92, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901400 Epoch 92, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 92, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902200 Epoch 92, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 92, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.902600 Epoch 92, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902000 Epoch 92, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 92, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901400 Epoch 92, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 92, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902200 Epoch 93, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 93, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 93, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 93, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 93, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 93, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901400 Epoch 93, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.902000 Epoch 93, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901200 Epoch 93, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901800 Epoch 93, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901200 Epoch 93, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 93, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.901800 Epoch 93, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 93, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902600 Epoch 93, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902400 Epoch 93, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902000 Epoch 93, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902400 Epoch 93, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902200 Epoch 93, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901400 Epoch 93, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 93, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 93, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 93, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 93, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 93, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 93, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 93, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 93, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 93, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 93, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 93, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 93, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901800 Epoch 93, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902400 Epoch 93, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902400 Epoch 93, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 93, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902800 Epoch 93, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 93, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901400 Epoch 93, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 93, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.901800 Epoch 93, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 93, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902600 Epoch 93, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 93, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 93, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 93, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 93, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 93, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901600 Epoch 93, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901400 Epoch 93, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 94, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 94, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 94, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 94, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 94, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 94, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 94, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 94, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 94, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 94, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 94, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 94, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902400 Epoch 94, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 94, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 94, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902600 Epoch 94, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902000 Epoch 94, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902200 Epoch 94, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 94, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 94, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902800 Epoch 94, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 94, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.903000 Epoch 94, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 94, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 94, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 94, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 94, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 94, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 94, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 94, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 94, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 94, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 94, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.901600 Epoch 94, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901200 Epoch 94, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 94, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902200 Epoch 94, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902200 Epoch 94, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 94, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 94, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902600 Epoch 94, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 94, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 94, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 94, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 94, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903400 Epoch 94, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 94, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 94, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 94, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 94, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 95, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 95, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 95, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 95, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 95, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 95, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 95, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 95, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901200 Epoch 95, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901400 Epoch 95, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 95, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 95, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902400 Epoch 95, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 95, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902600 Epoch 95, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903200 Epoch 95, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 95, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902200 Epoch 95, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 95, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 95, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 95, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 95, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 95, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 95, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 95, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 95, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903400 Epoch 95, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 95, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 95, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 95, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903200 Epoch 95, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 95, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901800 Epoch 95, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 95, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902000 Epoch 95, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 95, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902000 Epoch 95, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 95, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 95, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 95, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.901800 Epoch 95, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 95, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902600 Epoch 95, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902400 Epoch 95, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 95, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 95, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 95, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 95, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.902200 Epoch 95, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 95, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 96, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 96, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 96, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902200 Epoch 96, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901600 Epoch 96, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 96, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 96, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 96, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.902000 Epoch 96, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.902000 Epoch 96, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.902200 Epoch 96, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 96, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902000 Epoch 96, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 96, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903200 Epoch 96, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 96, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 96, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 96, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 96, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 96, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902800 Epoch 96, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 96, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 96, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 96, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 96, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 96, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903400 Epoch 96, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 96, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901800 Epoch 96, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 96, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902600 Epoch 96, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 96, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901800 Epoch 96, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902000 Epoch 96, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901800 Epoch 96, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 96, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 96, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 96, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 96, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 96, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 96, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 96, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 96, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 96, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 96, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 96, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902600 Epoch 96, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 96, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 96, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 96, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 97, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 97, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 97, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 97, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901800 Epoch 97, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 97, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.902000 Epoch 97, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 97, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.902000 Epoch 97, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901800 Epoch 97, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 97, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 97, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902400 Epoch 97, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 97, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 97, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 97, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 97, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902800 Epoch 97, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 97, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 97, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 97, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 97, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 97, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.902800 Epoch 97, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 97, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903000 Epoch 97, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 97, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 97, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 97, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901600 Epoch 97, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903200 Epoch 97, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 97, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901800 Epoch 97, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 97, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901800 Epoch 97, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 97, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 97, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 97, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901400 Epoch 97, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 97, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902600 Epoch 97, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 97, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 97, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902400 Epoch 97, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 97, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 97, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 97, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 97, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 97, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.902000 Epoch 97, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 98, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 98, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 98, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 98, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 98, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.902000 Epoch 98, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 98, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901800 Epoch 98, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 98, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901800 Epoch 98, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.902000 Epoch 98, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 98, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 98, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.901800 Epoch 98, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 98, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 98, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 98, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 98, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 98, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 98, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 98, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 98, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 98, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903600 Epoch 98, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 98, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903000 Epoch 98, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 98, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 98, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 98, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 98, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903200 Epoch 98, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 98, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901800 Epoch 98, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 98, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901400 Epoch 98, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902200 Epoch 98, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 98, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 98, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 98, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 98, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902800 Epoch 98, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 98, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 98, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 98, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 98, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903600 Epoch 98, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 98, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 98, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901400 Epoch 98, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 98, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 99, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901600 Epoch 99, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 99, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 99, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 99, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 99, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 99, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 99, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 99, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 99, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.902000 Epoch 99, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 99, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 99, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 99, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902400 Epoch 99, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 99, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902000 Epoch 99, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902400 Epoch 99, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902200 Epoch 99, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901000 Epoch 99, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 99, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 99, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902800 Epoch 99, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 99, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 99, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903600 Epoch 99, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 99, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 99, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902400 Epoch 99, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 99, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902600 Epoch 99, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 99, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 99, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902000 Epoch 99, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901800 Epoch 99, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902200 Epoch 99, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 99, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902800 Epoch 99, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 99, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 99, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 99, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 99, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 99, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902400 Epoch 99, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 99, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 99, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902600 Epoch 99, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902600 Epoch 99, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 99, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 99, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 100, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 100, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 100, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 100, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901600 Epoch 100, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 100, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 100, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 100, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 100, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 100, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901400 Epoch 100, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 100, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 100, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 100, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903400 Epoch 100, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 100, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 100, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902800 Epoch 100, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 100, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 100, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902800 Epoch 100, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 100, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 100, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903600 Epoch 100, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 100, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 100, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903400 Epoch 100, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 100, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 100, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 100, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 100, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 100, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 100, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 100, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901600 Epoch 100, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 100, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 100, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 100, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901400 Epoch 100, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 100, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 100, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 100, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 100, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.903000 Epoch 100, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 100, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 100, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 100, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 100, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.902000 Epoch 100, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901400 Epoch 100, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 101, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 101, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 101, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 101, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 101, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 101, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 101, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 101, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 101, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901400 Epoch 101, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.902000 Epoch 101, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 101, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902000 Epoch 101, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 101, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902800 Epoch 101, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903200 Epoch 101, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 101, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 101, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902800 Epoch 101, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 101, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902200 Epoch 101, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 101, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 101, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 101, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 101, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903000 Epoch 101, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 101, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 101, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 101, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901600 Epoch 101, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 101, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 101, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 101, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902400 Epoch 101, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901400 Epoch 101, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901400 Epoch 101, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 101, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 101, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 101, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 101, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 101, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 101, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 101, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 101, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903200 Epoch 101, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 101, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 101, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 101, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 101, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.902200 Epoch 101, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902200 Epoch 102, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 102, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 102, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 102, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 102, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.902000 Epoch 102, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 102, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 102, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 102, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 102, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 102, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902600 Epoch 102, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902600 Epoch 102, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.901800 Epoch 102, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 102, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902600 Epoch 102, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 102, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902800 Epoch 102, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 102, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 102, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 102, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 102, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902200 Epoch 102, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903000 Epoch 102, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 102, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903000 Epoch 102, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 102, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 102, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 102, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 102, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902600 Epoch 102, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 102, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 102, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 102, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901400 Epoch 102, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 102, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 102, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 102, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 102, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.901600 Epoch 102, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 102, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901400 Epoch 102, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 102, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 102, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 102, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 102, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 102, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 102, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 102, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 102, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901600 Epoch 103, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 103, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 103, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 103, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 103, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 103, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 103, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 103, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901800 Epoch 103, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901200 Epoch 103, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901400 Epoch 103, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 103, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 103, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 103, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 103, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903000 Epoch 103, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 103, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 103, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 103, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 103, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 103, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 103, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 103, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 103, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 103, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903000 Epoch 103, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 103, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 103, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 103, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 103, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 103, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902000 Epoch 103, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901600 Epoch 103, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902000 Epoch 103, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901600 Epoch 103, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901600 Epoch 103, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 103, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902800 Epoch 103, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901400 Epoch 103, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 103, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 103, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 103, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 103, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902200 Epoch 103, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 103, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 103, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902800 Epoch 103, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 103, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901600 Epoch 103, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901400 Epoch 103, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902200 Epoch 104, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 104, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 104, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 104, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 104, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 104, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 104, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 104, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 104, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901200 Epoch 104, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901400 Epoch 104, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 104, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902400 Epoch 104, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 104, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902400 Epoch 104, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902000 Epoch 104, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 104, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902800 Epoch 104, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902800 Epoch 104, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 104, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 104, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 104, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 104, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 104, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 104, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 104, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903400 Epoch 104, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 104, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 104, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 104, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 104, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 104, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902400 Epoch 104, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902400 Epoch 104, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902200 Epoch 104, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 104, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 104, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 104, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 104, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 104, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 104, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902200 Epoch 104, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 104, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 104, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 104, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 104, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 104, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 104, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 104, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 104, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 105, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 105, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 105, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 105, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 105, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 105, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901200 Epoch 105, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901000 Epoch 105, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 105, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901400 Epoch 105, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901400 Epoch 105, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 105, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 105, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 105, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 105, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 105, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 105, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902000 Epoch 105, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 105, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 105, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 105, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 105, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902800 Epoch 105, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 105, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.903000 Epoch 105, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903600 Epoch 105, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 105, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 105, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901600 Epoch 105, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902200 Epoch 105, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 105, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 105, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 105, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.901800 Epoch 105, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901800 Epoch 105, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901600 Epoch 105, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902200 Epoch 105, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 105, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 105, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 105, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.901800 Epoch 105, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 105, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902600 Epoch 105, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902400 Epoch 105, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 105, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 105, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902600 Epoch 105, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 105, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901600 Epoch 105, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 105, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 106, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 106, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 106, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 106, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901000 Epoch 106, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 106, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 106, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 106, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.902000 Epoch 106, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 106, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 106, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901400 Epoch 106, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 106, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.901800 Epoch 106, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 106, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 106, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 106, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902800 Epoch 106, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902800 Epoch 106, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 106, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902800 Epoch 106, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 106, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 106, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903600 Epoch 106, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 106, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903800 Epoch 106, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 106, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 106, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 106, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901600 Epoch 106, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 106, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 106, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 106, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902400 Epoch 106, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901800 Epoch 106, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 106, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 106, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 106, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 106, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902600 Epoch 106, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 106, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 106, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 106, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 106, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 106, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 106, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902600 Epoch 106, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 106, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 106, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 106, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 107, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901600 Epoch 107, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 107, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 107, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 107, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 107, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 107, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 107, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 107, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901200 Epoch 107, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901200 Epoch 107, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 107, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 107, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 107, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 107, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903000 Epoch 107, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 107, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 107, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 107, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 107, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902000 Epoch 107, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 107, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 107, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 107, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 107, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 107, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 107, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 107, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 107, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901400 Epoch 107, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 107, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 107, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901800 Epoch 107, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902800 Epoch 107, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902400 Epoch 107, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902200 Epoch 107, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 107, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 107, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 107, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 107, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 107, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901400 Epoch 107, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 107, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 107, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 107, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 107, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902000 Epoch 107, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 107, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.902000 Epoch 107, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 107, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 108, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901600 Epoch 108, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 108, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 108, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901800 Epoch 108, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 108, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 108, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 108, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901800 Epoch 108, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.902000 Epoch 108, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.902200 Epoch 108, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901600 Epoch 108, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902600 Epoch 108, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 108, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903400 Epoch 108, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902600 Epoch 108, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902800 Epoch 108, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902200 Epoch 108, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 108, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 108, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 108, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 108, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 108, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903000 Epoch 108, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 108, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903000 Epoch 108, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 108, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 108, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 108, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 108, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 108, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 108, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 108, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.903000 Epoch 108, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901600 Epoch 108, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 108, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 108, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 108, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 108, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 108, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 108, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 108, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 108, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 108, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 108, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903400 Epoch 108, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 108, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 108, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 108, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.902000 Epoch 108, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 109, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 109, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 109, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 109, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 109, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 109, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 109, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 109, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 109, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 109, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901400 Epoch 109, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 109, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 109, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 109, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902800 Epoch 109, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902200 Epoch 109, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 109, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902200 Epoch 109, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902200 Epoch 109, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 109, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 109, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 109, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902800 Epoch 109, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 109, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902400 Epoch 109, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.902600 Epoch 109, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 109, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 109, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 109, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 109, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 109, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 109, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901800 Epoch 109, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902600 Epoch 109, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902200 Epoch 109, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902200 Epoch 109, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 109, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 109, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 109, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 109, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.901800 Epoch 109, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 109, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 109, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 109, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 109, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903400 Epoch 109, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 109, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902600 Epoch 109, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.902000 Epoch 109, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 109, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 110, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 110, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 110, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 110, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 110, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 110, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 110, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 110, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901800 Epoch 110, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901800 Epoch 110, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.902000 Epoch 110, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 110, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902600 Epoch 110, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 110, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 110, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 110, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 110, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902800 Epoch 110, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 110, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 110, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902800 Epoch 110, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 110, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 110, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 110, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 110, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 110, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 110, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902400 Epoch 110, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 110, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 110, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 110, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902600 Epoch 110, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 110, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902400 Epoch 110, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901600 Epoch 110, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 110, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 110, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902200 Epoch 110, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901400 Epoch 110, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 110, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902600 Epoch 110, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 110, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 110, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 110, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 110, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 110, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 110, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 110, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901600 Epoch 110, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 110, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902200 Epoch 111, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 111, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 111, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 111, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 111, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.902000 Epoch 111, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 111, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 111, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 111, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 111, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901400 Epoch 111, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 111, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.901800 Epoch 111, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 111, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 111, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903000 Epoch 111, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 111, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 111, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902200 Epoch 111, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 111, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 111, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 111, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902800 Epoch 111, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903600 Epoch 111, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 111, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 111, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 111, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 111, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 111, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 111, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 111, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 111, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 111, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902600 Epoch 111, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902000 Epoch 111, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 111, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 111, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 111, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 111, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 111, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 111, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 111, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902600 Epoch 111, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 111, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 111, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 111, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 111, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 111, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 111, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 111, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901600 Epoch 112, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 112, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 112, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 112, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 112, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 112, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 112, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 112, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901200 Epoch 112, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901400 Epoch 112, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 112, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902400 Epoch 112, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902800 Epoch 112, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 112, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902800 Epoch 112, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903000 Epoch 112, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 112, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902200 Epoch 112, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 112, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 112, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.903000 Epoch 112, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902800 Epoch 112, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.903000 Epoch 112, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 112, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 112, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903000 Epoch 112, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 112, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 112, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 112, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901600 Epoch 112, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 112, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902000 Epoch 112, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 112, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 112, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901400 Epoch 112, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901600 Epoch 112, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 112, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902800 Epoch 112, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.902000 Epoch 112, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 112, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 112, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 112, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 112, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 112, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 112, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 112, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 112, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 112, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 112, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901400 Epoch 112, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 113, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 113, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 113, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 113, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 113, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 113, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 113, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 113, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 113, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 113, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901400 Epoch 113, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 113, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 113, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 113, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902600 Epoch 113, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903000 Epoch 113, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 113, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.903000 Epoch 113, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902800 Epoch 113, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901400 Epoch 113, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 113, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 113, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 113, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 113, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 113, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 113, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 113, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 113, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902400 Epoch 113, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 113, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902400 Epoch 113, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902000 Epoch 113, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 113, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 113, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902000 Epoch 113, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 113, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 113, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 113, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 113, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 113, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 113, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 113, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 113, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.903000 Epoch 113, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 113, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 113, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902600 Epoch 113, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 113, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 113, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.902000 Epoch 113, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902200 Epoch 114, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 114, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 114, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 114, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 114, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 114, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 114, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 114, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 114, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 114, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901400 Epoch 114, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 114, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 114, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902400 Epoch 114, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902600 Epoch 114, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902600 Epoch 114, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 114, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902400 Epoch 114, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 114, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 114, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902200 Epoch 114, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.903200 Epoch 114, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902800 Epoch 114, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 114, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 114, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 114, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903600 Epoch 114, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902400 Epoch 114, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 114, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 114, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903200 Epoch 114, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.901800 Epoch 114, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 114, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902600 Epoch 114, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902000 Epoch 114, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901600 Epoch 114, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 114, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 114, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 114, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 114, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.901800 Epoch 114, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901400 Epoch 114, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902200 Epoch 114, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 114, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 114, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.902800 Epoch 114, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902000 Epoch 114, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 114, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 114, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 114, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901400 Epoch 115, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 115, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 115, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 115, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 115, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 115, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 115, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901800 Epoch 115, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 115, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901400 Epoch 115, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 115, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 115, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.901800 Epoch 115, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 115, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902600 Epoch 115, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902400 Epoch 115, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 115, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902800 Epoch 115, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 115, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 115, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 115, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 115, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 115, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 115, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 115, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 115, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 115, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902400 Epoch 115, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 115, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 115, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 115, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902800 Epoch 115, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 115, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902400 Epoch 115, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901800 Epoch 115, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 115, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 115, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902800 Epoch 115, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 115, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 115, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 115, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 115, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 115, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902400 Epoch 115, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902400 Epoch 115, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 115, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 115, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 115, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901600 Epoch 115, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 115, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 116, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901600 Epoch 116, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 116, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 116, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 116, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 116, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 116, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 116, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901800 Epoch 116, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901800 Epoch 116, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 116, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901600 Epoch 116, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.901800 Epoch 116, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.901800 Epoch 116, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 116, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902400 Epoch 116, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 116, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902200 Epoch 116, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902200 Epoch 116, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901000 Epoch 116, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 116, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 116, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 116, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 116, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 116, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903000 Epoch 116, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 116, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 116, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 116, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 116, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 116, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 116, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 116, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902400 Epoch 116, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901600 Epoch 116, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 116, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 116, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902200 Epoch 116, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.902000 Epoch 116, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 116, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 116, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 116, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902600 Epoch 116, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 116, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 116, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 116, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.903000 Epoch 116, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 116, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901400 Epoch 116, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 116, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901400 Epoch 117, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 117, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 117, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902200 Epoch 117, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 117, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.902000 Epoch 117, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901400 Epoch 117, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 117, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 117, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 117, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901400 Epoch 117, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 117, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902400 Epoch 117, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 117, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902800 Epoch 117, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902600 Epoch 117, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 117, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902800 Epoch 117, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 117, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 117, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.903000 Epoch 117, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 117, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902800 Epoch 117, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 117, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 117, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903000 Epoch 117, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 117, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903200 Epoch 117, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901800 Epoch 117, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 117, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 117, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902000 Epoch 117, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901800 Epoch 117, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.901800 Epoch 117, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902000 Epoch 117, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 117, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 117, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 117, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 117, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 117, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 117, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 117, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903200 Epoch 117, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902400 Epoch 117, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 117, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 117, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 117, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 117, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.902000 Epoch 117, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 117, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 118, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 118, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 118, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 118, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901800 Epoch 118, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 118, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.902000 Epoch 118, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901800 Epoch 118, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901200 Epoch 118, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 118, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 118, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 118, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902600 Epoch 118, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 118, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 118, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903200 Epoch 118, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 118, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902400 Epoch 118, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 118, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 118, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902800 Epoch 118, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 118, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 118, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 118, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902400 Epoch 118, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 118, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903400 Epoch 118, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903200 Epoch 118, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902400 Epoch 118, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 118, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 118, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 118, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902400 Epoch 118, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902000 Epoch 118, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902000 Epoch 118, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 118, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902200 Epoch 118, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902200 Epoch 118, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901400 Epoch 118, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 118, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 118, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 118, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 118, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 118, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903200 Epoch 118, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 118, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902600 Epoch 118, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 118, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.902000 Epoch 118, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 118, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 119, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 119, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 119, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 119, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 119, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 119, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.902200 Epoch 119, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 119, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901800 Epoch 119, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 119, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.902000 Epoch 119, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902600 Epoch 119, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 119, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 119, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902800 Epoch 119, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902400 Epoch 119, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902000 Epoch 119, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902200 Epoch 119, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902800 Epoch 119, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901200 Epoch 119, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 119, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 119, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902800 Epoch 119, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 119, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 119, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 119, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 119, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 119, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901800 Epoch 119, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 119, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 119, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 119, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902400 Epoch 119, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902400 Epoch 119, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901800 Epoch 119, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 119, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902000 Epoch 119, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902200 Epoch 119, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 119, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 119, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 119, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 119, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 119, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 119, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 119, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 119, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902000 Epoch 119, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 119, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 119, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 119, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 120, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901600 Epoch 120, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 120, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 120, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 120, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 120, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 120, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 120, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 120, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901200 Epoch 120, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 120, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 120, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 120, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.901800 Epoch 120, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 120, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902600 Epoch 120, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 120, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902800 Epoch 120, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902800 Epoch 120, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 120, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 120, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 120, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902800 Epoch 120, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903600 Epoch 120, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 120, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 120, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 120, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 120, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 120, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 120, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 120, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 120, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 120, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902400 Epoch 120, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901600 Epoch 120, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902200 Epoch 120, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 120, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 120, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 120, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 120, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 120, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 120, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902200 Epoch 120, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 120, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 120, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 120, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 120, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 120, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.902000 Epoch 120, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 120, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902200 Epoch 121, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901600 Epoch 121, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 121, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 121, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 121, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.902000 Epoch 121, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901400 Epoch 121, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 121, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901800 Epoch 121, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 121, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 121, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 121, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.901800 Epoch 121, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.901800 Epoch 121, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 121, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903000 Epoch 121, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 121, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.903000 Epoch 121, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902800 Epoch 121, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 121, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 121, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 121, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 121, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903000 Epoch 121, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 121, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903600 Epoch 121, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 121, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 121, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901800 Epoch 121, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 121, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 121, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 121, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 121, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902000 Epoch 121, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902000 Epoch 121, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 121, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 121, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 121, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 121, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 121, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 121, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 121, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 121, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 121, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902600 Epoch 121, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903400 Epoch 121, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 121, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 121, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901600 Epoch 121, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 121, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 122, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 122, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 122, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 122, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 122, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 122, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901200 Epoch 122, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 122, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901000 Epoch 122, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901800 Epoch 122, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901400 Epoch 122, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 122, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902000 Epoch 122, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 122, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 122, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903000 Epoch 122, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 122, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 122, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902800 Epoch 122, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 122, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 122, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 122, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 122, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 122, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 122, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 122, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903400 Epoch 122, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 122, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 122, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 122, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 122, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 122, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 122, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902400 Epoch 122, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901600 Epoch 122, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 122, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 122, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 122, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901200 Epoch 122, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 122, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 122, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 122, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 122, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 122, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 122, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903400 Epoch 122, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 122, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 122, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901400 Epoch 122, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 122, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902200 Epoch 123, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 123, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 123, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 123, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 123, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 123, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901200 Epoch 123, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901800 Epoch 123, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 123, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 123, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 123, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902400 Epoch 123, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902600 Epoch 123, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 123, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903200 Epoch 123, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 123, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902600 Epoch 123, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 123, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 123, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 123, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902000 Epoch 123, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 123, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 123, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903600 Epoch 123, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 123, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903000 Epoch 123, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 123, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 123, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902400 Epoch 123, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 123, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902400 Epoch 123, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 123, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 123, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.901800 Epoch 123, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901400 Epoch 123, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 123, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 123, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902200 Epoch 123, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 123, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 123, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 123, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 123, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 123, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 123, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 123, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 123, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902600 Epoch 123, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902600 Epoch 123, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901600 Epoch 123, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 123, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 124, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 124, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901600 Epoch 124, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 124, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901600 Epoch 124, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 124, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901200 Epoch 124, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901200 Epoch 124, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901200 Epoch 124, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 124, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 124, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 124, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 124, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902400 Epoch 124, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 124, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902600 Epoch 124, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902600 Epoch 124, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902400 Epoch 124, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 124, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 124, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.903000 Epoch 124, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 124, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 124, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 124, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.903000 Epoch 124, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 124, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 124, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 124, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901800 Epoch 124, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 124, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 124, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 124, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 124, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902000 Epoch 124, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901600 Epoch 124, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901600 Epoch 124, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902800 Epoch 124, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 124, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901400 Epoch 124, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 124, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 124, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 124, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 124, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 124, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 124, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 124, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 124, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 124, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.902000 Epoch 124, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 124, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902200 Epoch 125, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 125, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 125, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 125, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 125, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 125, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901200 Epoch 125, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901200 Epoch 125, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 125, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901400 Epoch 125, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 125, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 125, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902800 Epoch 125, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 125, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 125, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 125, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902600 Epoch 125, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.903000 Epoch 125, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 125, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902200 Epoch 125, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 125, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 125, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 125, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903000 Epoch 125, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 125, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 125, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903400 Epoch 125, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 125, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 125, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 125, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903400 Epoch 125, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 125, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901600 Epoch 125, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902600 Epoch 125, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901800 Epoch 125, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 125, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 125, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902200 Epoch 125, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 125, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 125, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 125, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 125, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902600 Epoch 125, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 125, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 125, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 125, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 125, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 125, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 125, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 125, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 126, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 126, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 126, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 126, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 126, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 126, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 126, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 126, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901800 Epoch 126, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901800 Epoch 126, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.902000 Epoch 126, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 126, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 126, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902600 Epoch 126, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 126, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 126, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902600 Epoch 126, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902200 Epoch 126, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902800 Epoch 126, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 126, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 126, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902800 Epoch 126, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.903000 Epoch 126, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903600 Epoch 126, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 126, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 126, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903400 Epoch 126, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 126, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 126, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 126, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 126, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902600 Epoch 126, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 126, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902000 Epoch 126, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901400 Epoch 126, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 126, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 126, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 126, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 126, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 126, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 126, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 126, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 126, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 126, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 126, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 126, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902600 Epoch 126, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 126, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 126, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 126, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902200 Epoch 127, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 127, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901800 Epoch 127, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 127, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901600 Epoch 127, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 127, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 127, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 127, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901800 Epoch 127, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 127, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 127, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 127, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 127, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 127, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902800 Epoch 127, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 127, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 127, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 127, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 127, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 127, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 127, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 127, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 127, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 127, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 127, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 127, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 127, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 127, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901800 Epoch 127, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 127, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 127, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 127, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901600 Epoch 127, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 127, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902200 Epoch 127, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902200 Epoch 127, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 127, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 127, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 127, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 127, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 127, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 127, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 127, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 127, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 127, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903400 Epoch 127, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902000 Epoch 127, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 127, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 127, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 127, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 128, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901600 Epoch 128, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 128, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 128, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 128, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.902000 Epoch 128, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.902000 Epoch 128, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 128, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.902000 Epoch 128, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.902000 Epoch 128, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 128, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902600 Epoch 128, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 128, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902400 Epoch 128, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903200 Epoch 128, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903000 Epoch 128, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 128, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.903200 Epoch 128, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 128, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 128, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902000 Epoch 128, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 128, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 128, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 128, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 128, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903600 Epoch 128, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.902800 Epoch 128, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 128, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 128, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 128, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 128, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902000 Epoch 128, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901800 Epoch 128, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902000 Epoch 128, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902200 Epoch 128, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902200 Epoch 128, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 128, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 128, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 128, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 128, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 128, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 128, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 128, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 128, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 128, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.902800 Epoch 128, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 128, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 128, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 128, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 128, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902200 Epoch 129, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901600 Epoch 129, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901800 Epoch 129, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.901800 Epoch 129, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 129, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901400 Epoch 129, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 129, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 129, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901800 Epoch 129, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901800 Epoch 129, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 129, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 129, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902400 Epoch 129, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.901800 Epoch 129, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903200 Epoch 129, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903000 Epoch 129, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 129, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902800 Epoch 129, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 129, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 129, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902200 Epoch 129, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 129, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 129, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 129, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 129, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 129, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903600 Epoch 129, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 129, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 129, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 129, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 129, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 129, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 129, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 129, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901600 Epoch 129, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901400 Epoch 129, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 129, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 129, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901400 Epoch 129, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 129, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 129, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 129, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902600 Epoch 129, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902400 Epoch 129, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902600 Epoch 129, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 129, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902600 Epoch 129, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 129, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901400 Epoch 129, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 129, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 130, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 130, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 130, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 130, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 130, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.902000 Epoch 130, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.902000 Epoch 130, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 130, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.902000 Epoch 130, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 130, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.902000 Epoch 130, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 130, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902000 Epoch 130, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 130, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902800 Epoch 130, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903000 Epoch 130, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 130, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902400 Epoch 130, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902200 Epoch 130, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 130, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902200 Epoch 130, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 130, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 130, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 130, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902400 Epoch 130, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 130, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 130, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 130, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 130, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 130, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 130, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 130, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 130, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 130, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901600 Epoch 130, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901600 Epoch 130, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 130, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 130, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 130, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 130, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 130, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 130, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902600 Epoch 130, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902400 Epoch 130, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 130, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 130, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902000 Epoch 130, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 130, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901200 Epoch 130, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 130, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 131, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901600 Epoch 131, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 131, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 131, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 131, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 131, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.902000 Epoch 131, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 131, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901200 Epoch 131, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 131, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 131, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901600 Epoch 131, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 131, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.901800 Epoch 131, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 131, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903200 Epoch 131, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 131, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.903000 Epoch 131, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902800 Epoch 131, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 131, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902200 Epoch 131, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 131, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902800 Epoch 131, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 131, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 131, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 131, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 131, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 131, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901800 Epoch 131, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 131, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 131, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 131, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 131, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902800 Epoch 131, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901800 Epoch 131, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 131, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902200 Epoch 131, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 131, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 131, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 131, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 131, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 131, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902400 Epoch 131, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.903000 Epoch 131, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903400 Epoch 131, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.902800 Epoch 131, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 131, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 131, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 131, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.902000 Epoch 131, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 132, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901400 Epoch 132, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 132, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 132, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901600 Epoch 132, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 132, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 132, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 132, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 132, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 132, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 132, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 132, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902400 Epoch 132, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 132, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903200 Epoch 132, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902600 Epoch 132, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 132, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902800 Epoch 132, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 132, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 132, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 132, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 132, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 132, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903000 Epoch 132, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 132, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 132, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903600 Epoch 132, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 132, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 132, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 132, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902600 Epoch 132, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.901800 Epoch 132, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 132, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902000 Epoch 132, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901200 Epoch 132, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901200 Epoch 132, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 132, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902200 Epoch 132, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 132, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 132, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 132, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 132, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 132, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902400 Epoch 132, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 132, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.902800 Epoch 132, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 132, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 132, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 132, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 132, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902200 Epoch 133, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901600 Epoch 133, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 133, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 133, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 133, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.902000 Epoch 133, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 133, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 133, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 133, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 133, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901400 Epoch 133, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901600 Epoch 133, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.901800 Epoch 133, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 133, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903200 Epoch 133, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902400 Epoch 133, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 133, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902400 Epoch 133, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902800 Epoch 133, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 133, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 133, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 133, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902800 Epoch 133, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 133, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 133, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903600 Epoch 133, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 133, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 133, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901800 Epoch 133, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901600 Epoch 133, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 133, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 133, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 133, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902400 Epoch 133, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902200 Epoch 133, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 133, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 133, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 133, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901200 Epoch 133, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 133, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 133, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 133, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 133, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 133, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903200 Epoch 133, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 133, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 133, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 133, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 133, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901400 Epoch 133, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 134, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 134, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 134, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 134, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 134, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 134, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 134, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901800 Epoch 134, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901800 Epoch 134, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901400 Epoch 134, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.902000 Epoch 134, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 134, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 134, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.901800 Epoch 134, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 134, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902200 Epoch 134, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 134, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 134, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 134, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 134, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 134, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 134, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 134, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 134, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 134, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 134, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903400 Epoch 134, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 134, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901800 Epoch 134, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 134, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 134, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 134, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902400 Epoch 134, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 134, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902000 Epoch 134, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902200 Epoch 134, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902200 Epoch 134, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 134, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 134, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 134, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902800 Epoch 134, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901400 Epoch 134, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902600 Epoch 134, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902200 Epoch 134, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 134, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 134, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902600 Epoch 134, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 134, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901600 Epoch 134, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 134, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 135, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 135, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 135, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 135, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 135, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 135, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.902000 Epoch 135, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901200 Epoch 135, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 135, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 135, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 135, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 135, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902400 Epoch 135, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 135, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902800 Epoch 135, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902400 Epoch 135, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 135, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 135, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 135, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 135, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902200 Epoch 135, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 135, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 135, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 135, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 135, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903000 Epoch 135, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 135, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 135, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 135, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901600 Epoch 135, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 135, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 135, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 135, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902800 Epoch 135, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901600 Epoch 135, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 135, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 135, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 135, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901400 Epoch 135, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 135, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 135, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 135, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 135, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902400 Epoch 135, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 135, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 135, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.901800 Epoch 135, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902600 Epoch 135, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901400 Epoch 135, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.902000 Epoch 135, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902200 Epoch 136, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 136, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 136, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 136, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 136, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 136, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901400 Epoch 136, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 136, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 136, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901200 Epoch 136, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 136, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901600 Epoch 136, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 136, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 136, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903400 Epoch 136, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903200 Epoch 136, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902800 Epoch 136, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 136, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 136, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 136, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 136, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 136, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 136, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 136, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 136, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 136, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 136, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 136, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901800 Epoch 136, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 136, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 136, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 136, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 136, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902000 Epoch 136, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901400 Epoch 136, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 136, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 136, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 136, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 136, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 136, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 136, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 136, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 136, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 136, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 136, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 136, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902800 Epoch 136, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 136, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901600 Epoch 136, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 136, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 137, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 137, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 137, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 137, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 137, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 137, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 137, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 137, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901200 Epoch 137, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901200 Epoch 137, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901200 Epoch 137, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 137, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 137, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 137, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902400 Epoch 137, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902200 Epoch 137, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 137, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.903000 Epoch 137, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902200 Epoch 137, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901400 Epoch 137, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902800 Epoch 137, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902800 Epoch 137, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902800 Epoch 137, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903600 Epoch 137, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 137, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.902600 Epoch 137, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 137, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 137, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 137, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 137, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903200 Epoch 137, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 137, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 137, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902600 Epoch 137, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901800 Epoch 137, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 137, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 137, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902800 Epoch 137, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 137, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 137, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.901800 Epoch 137, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 137, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 137, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902400 Epoch 137, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 137, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 137, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 137, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 137, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 137, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 137, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 138, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 138, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 138, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 138, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 138, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 138, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 138, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 138, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901800 Epoch 138, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901800 Epoch 138, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 138, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 138, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 138, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 138, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903400 Epoch 138, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 138, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 138, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 138, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 138, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 138, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 138, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 138, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 138, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 138, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 138, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 138, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903400 Epoch 138, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902400 Epoch 138, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901800 Epoch 138, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 138, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 138, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.903000 Epoch 138, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901800 Epoch 138, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902000 Epoch 138, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901800 Epoch 138, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 138, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 138, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 138, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 138, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 138, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 138, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902200 Epoch 138, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902600 Epoch 138, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902000 Epoch 138, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 138, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 138, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 138, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 138, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 138, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 138, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902200 Epoch 139, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 139, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 139, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 139, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901600 Epoch 139, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.902000 Epoch 139, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 139, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 139, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901800 Epoch 139, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901800 Epoch 139, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 139, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 139, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902600 Epoch 139, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 139, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902800 Epoch 139, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902600 Epoch 139, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902600 Epoch 139, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 139, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 139, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 139, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902000 Epoch 139, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.903000 Epoch 139, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902200 Epoch 139, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 139, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 139, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 139, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 139, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 139, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 139, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901400 Epoch 139, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 139, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902000 Epoch 139, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 139, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 139, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902000 Epoch 139, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 139, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 139, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 139, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901400 Epoch 139, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 139, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 139, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 139, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 139, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 139, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 139, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 139, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902800 Epoch 139, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 139, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901600 Epoch 139, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 139, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901600 Epoch 140, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901600 Epoch 140, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 140, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.901800 Epoch 140, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901000 Epoch 140, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.902000 Epoch 140, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 140, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 140, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901200 Epoch 140, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901400 Epoch 140, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.902000 Epoch 140, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 140, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 140, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 140, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903200 Epoch 140, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 140, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 140, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.903000 Epoch 140, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 140, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 140, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 140, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 140, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902200 Epoch 140, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903000 Epoch 140, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 140, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.902800 Epoch 140, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 140, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 140, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901800 Epoch 140, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901600 Epoch 140, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903200 Epoch 140, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 140, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 140, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902400 Epoch 140, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902200 Epoch 140, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 140, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902800 Epoch 140, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 140, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 140, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 140, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 140, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902200 Epoch 140, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 140, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 140, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902600 Epoch 140, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 140, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 140, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 140, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901600 Epoch 140, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 140, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 141, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 141, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 141, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 141, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901600 Epoch 141, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 141, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 141, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 141, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901200 Epoch 141, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 141, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 141, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 141, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 141, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 141, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 141, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 141, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 141, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902400 Epoch 141, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902200 Epoch 141, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 141, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 141, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 141, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902200 Epoch 141, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 141, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 141, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903000 Epoch 141, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.902800 Epoch 141, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 141, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901600 Epoch 141, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 141, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903200 Epoch 141, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902000 Epoch 141, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902400 Epoch 141, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902000 Epoch 141, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901400 Epoch 141, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 141, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 141, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 141, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 141, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 141, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 141, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 141, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 141, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 141, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 141, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.902800 Epoch 141, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 141, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 141, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 141, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 141, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901600 Epoch 142, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 142, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 142, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 142, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 142, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 142, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901200 Epoch 142, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 142, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 142, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 142, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 142, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 142, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902400 Epoch 142, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 142, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903200 Epoch 142, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902600 Epoch 142, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902000 Epoch 142, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902800 Epoch 142, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 142, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 142, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902200 Epoch 142, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 142, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 142, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 142, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 142, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 142, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 142, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 142, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 142, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 142, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 142, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 142, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901600 Epoch 142, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902600 Epoch 142, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902200 Epoch 142, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 142, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902000 Epoch 142, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 142, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 142, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 142, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 142, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 142, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 142, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 142, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 142, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 142, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902600 Epoch 142, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 142, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 142, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 142, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 143, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901600 Epoch 143, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 143, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 143, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 143, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 143, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 143, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 143, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901200 Epoch 143, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901800 Epoch 143, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.902000 Epoch 143, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 143, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 143, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 143, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902800 Epoch 143, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903000 Epoch 143, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 143, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 143, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902200 Epoch 143, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901400 Epoch 143, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902200 Epoch 143, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 143, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 143, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 143, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 143, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903000 Epoch 143, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 143, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 143, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902400 Epoch 143, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 143, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 143, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 143, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 143, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902600 Epoch 143, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901600 Epoch 143, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 143, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902200 Epoch 143, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 143, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 143, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 143, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902600 Epoch 143, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 143, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 143, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902400 Epoch 143, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 143, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 143, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 143, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 143, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901600 Epoch 143, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 143, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 144, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 144, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901600 Epoch 144, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 144, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 144, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 144, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 144, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 144, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901800 Epoch 144, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 144, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 144, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 144, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902800 Epoch 144, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 144, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903400 Epoch 144, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902600 Epoch 144, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 144, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902200 Epoch 144, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902800 Epoch 144, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 144, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 144, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 144, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 144, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 144, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 144, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 144, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903400 Epoch 144, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 144, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 144, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902200 Epoch 144, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902600 Epoch 144, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902000 Epoch 144, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901800 Epoch 144, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902800 Epoch 144, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902200 Epoch 144, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901600 Epoch 144, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 144, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 144, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 144, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 144, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 144, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 144, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 144, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.903000 Epoch 144, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 144, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903400 Epoch 144, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 144, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 144, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901600 Epoch 144, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 144, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 145, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 145, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 145, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 145, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 145, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 145, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 145, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 145, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 145, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901400 Epoch 145, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901400 Epoch 145, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 145, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902000 Epoch 145, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 145, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903200 Epoch 145, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 145, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 145, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902400 Epoch 145, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 145, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 145, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 145, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 145, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902800 Epoch 145, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 145, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 145, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 145, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 145, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 145, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 145, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 145, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 145, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 145, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 145, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902000 Epoch 145, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902400 Epoch 145, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 145, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 145, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 145, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901400 Epoch 145, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 145, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902600 Epoch 145, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901400 Epoch 145, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 145, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 145, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903200 Epoch 145, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903400 Epoch 145, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902000 Epoch 145, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 145, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.902200 Epoch 145, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 145, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901600 Epoch 146, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901600 Epoch 146, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901600 Epoch 146, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 146, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 146, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 146, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 146, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 146, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 146, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901800 Epoch 146, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 146, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 146, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.901800 Epoch 146, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 146, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 146, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902600 Epoch 146, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 146, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902400 Epoch 146, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 146, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 146, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 146, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 146, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 146, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 146, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 146, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 146, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 146, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 146, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 146, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 146, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 146, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.901800 Epoch 146, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 146, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902600 Epoch 146, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901800 Epoch 146, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902200 Epoch 146, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 146, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 146, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 146, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 146, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 146, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 146, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902600 Epoch 146, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902400 Epoch 146, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 146, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903400 Epoch 146, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902600 Epoch 146, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902600 Epoch 146, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 146, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 146, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 147, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 147, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 147, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 147, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901600 Epoch 147, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 147, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 147, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.902000 Epoch 147, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 147, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901200 Epoch 147, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901200 Epoch 147, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 147, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 147, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.901600 Epoch 147, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902600 Epoch 147, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902400 Epoch 147, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902600 Epoch 147, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902400 Epoch 147, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902800 Epoch 147, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 147, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 147, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902800 Epoch 147, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 147, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 147, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 147, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903000 Epoch 147, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 147, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 147, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 147, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 147, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 147, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 147, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901600 Epoch 147, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902400 Epoch 147, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901600 Epoch 147, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 147, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 147, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902200 Epoch 147, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901400 Epoch 147, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 147, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 147, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902200 Epoch 147, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 147, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 147, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903400 Epoch 147, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903400 Epoch 147, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902800 Epoch 147, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 147, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 147, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 147, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901600 Epoch 148, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 148, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901600 Epoch 148, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 148, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 148, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.902000 Epoch 148, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 148, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 148, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901000 Epoch 148, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 148, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 148, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 148, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902000 Epoch 148, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 148, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902800 Epoch 148, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902000 Epoch 148, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 148, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902400 Epoch 148, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 148, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 148, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 148, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 148, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 148, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903600 Epoch 148, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 148, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.902800 Epoch 148, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 148, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902200 Epoch 148, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 148, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901600 Epoch 148, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 148, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 148, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 148, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902000 Epoch 148, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901400 Epoch 148, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 148, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 148, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 148, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 148, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 148, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 148, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 148, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 148, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902400 Epoch 148, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902600 Epoch 148, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903400 Epoch 148, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 148, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 148, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901600 Epoch 148, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 148, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901600 Epoch 149, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901600 Epoch 149, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 149, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 149, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 149, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.902000 Epoch 149, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901200 Epoch 149, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901200 Epoch 149, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901200 Epoch 149, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901400 Epoch 149, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901400 Epoch 149, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 149, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902400 Epoch 149, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 149, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902800 Epoch 149, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902600 Epoch 149, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 149, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 149, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 149, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 149, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 149, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 149, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 149, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903600 Epoch 149, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 149, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 149, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 149, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 149, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 149, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 149, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 149, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 149, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 149, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902000 Epoch 149, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902200 Epoch 149, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 149, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 149, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 149, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901400 Epoch 149, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 149, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 149, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 149, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 149, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.903000 Epoch 149, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 149, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903400 Epoch 149, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902600 Epoch 149, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 149, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901400 Epoch 149, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 149, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 150, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 150, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 150, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 150, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 150, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 150, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.902000 Epoch 150, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901800 Epoch 150, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 150, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901800 Epoch 150, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.902000 Epoch 150, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 150, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902400 Epoch 150, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.901600 Epoch 150, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902400 Epoch 150, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903200 Epoch 150, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 150, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902400 Epoch 150, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 150, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 150, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 150, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 150, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 150, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903600 Epoch 150, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 150, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 150, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 150, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 150, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902400 Epoch 150, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 150, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 150, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 150, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 150, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.903000 Epoch 150, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901400 Epoch 150, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901600 Epoch 150, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 150, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902200 Epoch 150, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 150, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 150, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 150, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 150, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 150, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 150, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903200 Epoch 150, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903400 Epoch 150, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902000 Epoch 150, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902600 Epoch 150, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.902400 Epoch 150, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 150, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 151, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 151, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901600 Epoch 151, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 151, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901600 Epoch 151, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 151, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901400 Epoch 151, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901000 Epoch 151, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901200 Epoch 151, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901800 Epoch 151, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 151, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901600 Epoch 151, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902400 Epoch 151, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 151, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902600 Epoch 151, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902400 Epoch 151, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 151, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902800 Epoch 151, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 151, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 151, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 151, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 151, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902800 Epoch 151, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 151, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 151, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 151, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 151, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 151, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 151, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902400 Epoch 151, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903200 Epoch 151, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 151, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 151, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 151, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902200 Epoch 151, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 151, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902200 Epoch 151, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 151, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901400 Epoch 151, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 151, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.903000 Epoch 151, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 151, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 151, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902400 Epoch 151, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902600 Epoch 151, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 151, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 151, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 151, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901600 Epoch 151, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 151, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901600 Epoch 152, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901600 Epoch 152, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901600 Epoch 152, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 152, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 152, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901400 Epoch 152, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 152, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 152, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 152, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901400 Epoch 152, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 152, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 152, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902600 Epoch 152, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.901800 Epoch 152, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902600 Epoch 152, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902400 Epoch 152, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 152, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.903000 Epoch 152, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902800 Epoch 152, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 152, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 152, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902800 Epoch 152, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 152, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 152, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902400 Epoch 152, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 152, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 152, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 152, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901400 Epoch 152, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902200 Epoch 152, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 152, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 152, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901800 Epoch 152, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902000 Epoch 152, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902000 Epoch 152, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 152, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 152, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 152, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901400 Epoch 152, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 152, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902600 Epoch 152, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 152, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.903000 Epoch 152, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 152, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 152, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903400 Epoch 152, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 152, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902600 Epoch 152, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 152, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 152, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 153, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 153, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 153, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 153, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901600 Epoch 153, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 153, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 153, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 153, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 153, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901800 Epoch 153, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 153, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 153, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 153, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.901400 Epoch 153, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 153, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 153, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 153, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902400 Epoch 153, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 153, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 153, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 153, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 153, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 153, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903000 Epoch 153, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 153, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 153, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 153, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 153, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 153, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902200 Epoch 153, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 153, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.901800 Epoch 153, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901600 Epoch 153, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 153, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902200 Epoch 153, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 153, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 153, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 153, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.902000 Epoch 153, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 153, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.901600 Epoch 153, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 153, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902600 Epoch 153, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902400 Epoch 153, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902600 Epoch 153, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903400 Epoch 153, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902800 Epoch 153, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 153, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 153, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 153, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 154, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 154, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 154, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 154, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 154, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.902000 Epoch 154, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 154, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901200 Epoch 154, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 154, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901400 Epoch 154, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.902200 Epoch 154, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 154, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 154, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 154, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903400 Epoch 154, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903000 Epoch 154, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 154, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 154, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902200 Epoch 154, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 154, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 154, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902800 Epoch 154, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 154, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 154, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 154, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 154, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 154, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 154, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 154, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901600 Epoch 154, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 154, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 154, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902400 Epoch 154, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902800 Epoch 154, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901400 Epoch 154, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 154, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 154, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902800 Epoch 154, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 154, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 154, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 154, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 154, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 154, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.903000 Epoch 154, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903200 Epoch 154, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 154, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902000 Epoch 154, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902600 Epoch 154, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 154, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 154, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 155, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901400 Epoch 155, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 155, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.901800 Epoch 155, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 155, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 155, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 155, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 155, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901200 Epoch 155, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 155, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 155, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 155, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902000 Epoch 155, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 155, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 155, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902200 Epoch 155, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 155, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902800 Epoch 155, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 155, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 155, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 155, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 155, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 155, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 155, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 155, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 155, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 155, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 155, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 155, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 155, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902800 Epoch 155, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 155, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901800 Epoch 155, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.901800 Epoch 155, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901800 Epoch 155, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 155, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902200 Epoch 155, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 155, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901400 Epoch 155, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 155, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 155, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 155, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 155, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 155, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 155, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 155, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 155, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902600 Epoch 155, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.902000 Epoch 155, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901400 Epoch 155, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902200 Epoch 156, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 156, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 156, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 156, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901800 Epoch 156, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 156, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 156, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901400 Epoch 156, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901800 Epoch 156, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.902000 Epoch 156, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901400 Epoch 156, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901600 Epoch 156, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902000 Epoch 156, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 156, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902600 Epoch 156, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.903000 Epoch 156, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 156, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 156, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 156, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 156, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902200 Epoch 156, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 156, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902800 Epoch 156, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 156, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 156, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 156, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 156, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 156, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901800 Epoch 156, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 156, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903200 Epoch 156, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 156, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 156, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 156, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902000 Epoch 156, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 156, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 156, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 156, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901400 Epoch 156, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 156, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 156, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 156, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 156, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 156, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 156, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 156, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902000 Epoch 156, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 156, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901600 Epoch 156, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 156, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901800 Epoch 157, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 157, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 157, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 157, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 157, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901200 Epoch 157, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 157, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 157, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.902000 Epoch 157, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.902000 Epoch 157, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 157, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 157, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902600 Epoch 157, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 157, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 157, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 157, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 157, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 157, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 157, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901800 Epoch 157, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 157, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 157, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902200 Epoch 157, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 157, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 157, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903200 Epoch 157, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 157, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 157, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902400 Epoch 157, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902400 Epoch 157, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 157, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 157, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 157, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 157, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901800 Epoch 157, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 157, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902000 Epoch 157, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 157, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 157, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 157, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 157, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902200 Epoch 157, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 157, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 157, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 157, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.902600 Epoch 157, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902000 Epoch 157, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 157, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 157, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 157, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902200 Epoch 158, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 158, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 158, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.901800 Epoch 158, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 158, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901400 Epoch 158, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 158, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901000 Epoch 158, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 158, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901400 Epoch 158, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 158, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901600 Epoch 158, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902000 Epoch 158, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.901800 Epoch 158, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902800 Epoch 158, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902200 Epoch 158, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 158, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902800 Epoch 158, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 158, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902200 Epoch 158, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902800 Epoch 158, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 158, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 158, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 158, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 158, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903000 Epoch 158, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903400 Epoch 158, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 158, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 158, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 158, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902600 Epoch 158, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 158, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 158, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 158, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901600 Epoch 158, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 158, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 158, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902400 Epoch 158, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 158, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 158, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902000 Epoch 158, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 158, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902400 Epoch 158, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 158, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902600 Epoch 158, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 158, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 158, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 158, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.902000 Epoch 158, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.902000 Epoch 158, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 159, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 159, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 159, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.901800 Epoch 159, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 159, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.902000 Epoch 159, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 159, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 159, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901800 Epoch 159, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901400 Epoch 159, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 159, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 159, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902000 Epoch 159, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902000 Epoch 159, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902800 Epoch 159, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902600 Epoch 159, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 159, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902200 Epoch 159, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 159, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 159, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902000 Epoch 159, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 159, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 159, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 159, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 159, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903600 Epoch 159, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 159, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 159, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901800 Epoch 159, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 159, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.902600 Epoch 159, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 159, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901800 Epoch 159, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 159, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901800 Epoch 159, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902200 Epoch 159, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 159, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 159, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 159, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.901800 Epoch 159, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902600 Epoch 159, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901600 Epoch 159, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 159, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 159, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902600 Epoch 159, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903200 Epoch 159, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 159, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902200 Epoch 159, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 159, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 159, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902200 Epoch 160, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 160, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901200 Epoch 160, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 160, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 160, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 160, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901600 Epoch 160, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 160, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 160, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 160, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 160, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901600 Epoch 160, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902000 Epoch 160, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 160, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902600 Epoch 160, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902400 Epoch 160, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 160, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902400 Epoch 160, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 160, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 160, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902200 Epoch 160, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 160, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902400 Epoch 160, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 160, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 160, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 160, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 160, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902400 Epoch 160, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 160, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 160, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 160, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902000 Epoch 160, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.901800 Epoch 160, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 160, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902000 Epoch 160, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 160, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902600 Epoch 160, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 160, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 160, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902600 Epoch 160, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902400 Epoch 160, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 160, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902600 Epoch 160, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.903000 Epoch 160, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 160, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.902800 Epoch 160, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 160, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 160, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.902000 Epoch 160, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 160, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902400 Epoch 161, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 161, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 161, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 161, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901600 Epoch 161, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.902000 Epoch 161, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901400 Epoch 161, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901200 Epoch 161, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 161, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901200 Epoch 161, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901400 Epoch 161, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.901800 Epoch 161, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902000 Epoch 161, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 161, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903200 Epoch 161, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902400 Epoch 161, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 161, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.903000 Epoch 161, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 161, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902200 Epoch 161, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 161, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 161, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 161, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.902800 Epoch 161, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 161, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903600 Epoch 161, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 161, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 161, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902200 Epoch 161, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901600 Epoch 161, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 161, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902400 Epoch 161, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 161, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 161, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901200 Epoch 161, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 161, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 161, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902200 Epoch 161, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 161, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902400 Epoch 161, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 161, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902200 Epoch 161, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 161, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 161, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 161, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903400 Epoch 161, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902200 Epoch 161, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 161, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.902000 Epoch 161, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901800 Epoch 161, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901600 Epoch 162, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 162, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 162, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 162, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901200 Epoch 162, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901800 Epoch 162, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901400 Epoch 162, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 162, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901600 Epoch 162, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 162, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901600 Epoch 162, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902400 Epoch 162, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902600 Epoch 162, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902400 Epoch 162, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.903000 Epoch 162, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902600 Epoch 162, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.901800 Epoch 162, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902800 Epoch 162, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 162, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 162, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902400 Epoch 162, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902400 Epoch 162, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 162, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903400 Epoch 162, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902800 Epoch 162, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 162, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 162, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902600 Epoch 162, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 162, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902200 Epoch 162, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903200 Epoch 162, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902000 Epoch 162, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902200 Epoch 162, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902400 Epoch 162, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.901800 Epoch 162, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 162, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902800 Epoch 162, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 162, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901800 Epoch 162, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 162, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.901800 Epoch 162, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 162, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 162, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 162, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.902800 Epoch 162, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903400 Epoch 162, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902400 Epoch 162, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 162, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901400 Epoch 162, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 162, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901400 Epoch 163, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.902000 Epoch 163, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 163, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 163, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901800 Epoch 163, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901600 Epoch 163, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 163, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 163, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901000 Epoch 163, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901600 Epoch 163, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 163, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902200 Epoch 163, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.902200 Epoch 163, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902400 Epoch 163, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902800 Epoch 163, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902800 Epoch 163, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902400 Epoch 163, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.903000 Epoch 163, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902400 Epoch 163, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.901600 Epoch 163, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902000 Epoch 163, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 163, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 163, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903200 Epoch 163, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 163, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903600 Epoch 163, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903200 Epoch 163, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.903000 Epoch 163, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.902000 Epoch 163, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.902000 Epoch 163, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903400 Epoch 163, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902200 Epoch 163, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 163, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.902200 Epoch 163, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902200 Epoch 163, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.902000 Epoch 163, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 163, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 163, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901400 Epoch 163, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902200 Epoch 163, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902600 Epoch 163, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.902000 Epoch 163, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 163, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902800 Epoch 163, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903200 Epoch 163, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.902800 Epoch 163, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902000 Epoch 163, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 163, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.902200 Epoch 163, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 163, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.902000 Epoch 164, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.901800 Epoch 164, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.901400 Epoch 164, CIFAR-10 Batch 3: Loss: 0.1199 Validation Accuracy: 0.902000 Epoch 164, CIFAR-10 Batch 4: Loss: 0.1313 Validation Accuracy: 0.901400 Epoch 164, CIFAR-10 Batch 5: Loss: 0.1689 Validation Accuracy: 0.901400 Epoch 164, CIFAR-10 Batch 6: Loss: 0.2171 Validation Accuracy: 0.901800 Epoch 164, CIFAR-10 Batch 7: Loss: 0.1832 Validation Accuracy: 0.901600 Epoch 164, CIFAR-10 Batch 8: Loss: 0.2928 Validation Accuracy: 0.901400 Epoch 164, CIFAR-10 Batch 9: Loss: 0.1792 Validation Accuracy: 0.901200 Epoch 164, CIFAR-10 Batch 10: Loss: 0.1262 Validation Accuracy: 0.901800 Epoch 164, CIFAR-10 Batch 11: Loss: 0.1335 Validation Accuracy: 0.902000 Epoch 164, CIFAR-10 Batch 12: Loss: 0.1331 Validation Accuracy: 0.901800 Epoch 164, CIFAR-10 Batch 13: Loss: 0.1466 Validation Accuracy: 0.902200 Epoch 164, CIFAR-10 Batch 14: Loss: 0.1396 Validation Accuracy: 0.902800 Epoch 164, CIFAR-10 Batch 15: Loss: 0.1269 Validation Accuracy: 0.902600 Epoch 164, CIFAR-10 Batch 16: Loss: 0.1536 Validation Accuracy: 0.902200 Epoch 164, CIFAR-10 Batch 17: Loss: 0.1910 Validation Accuracy: 0.902600 Epoch 164, CIFAR-10 Batch 18: Loss: 0.1308 Validation Accuracy: 0.902600 Epoch 164, CIFAR-10 Batch 19: Loss: 0.1365 Validation Accuracy: 0.902000 Epoch 164, CIFAR-10 Batch 20: Loss: 0.1539 Validation Accuracy: 0.902600 Epoch 164, CIFAR-10 Batch 21: Loss: 0.1322 Validation Accuracy: 0.902600 Epoch 164, CIFAR-10 Batch 22: Loss: 0.1501 Validation Accuracy: 0.902600 Epoch 164, CIFAR-10 Batch 23: Loss: 0.1272 Validation Accuracy: 0.903000 Epoch 164, CIFAR-10 Batch 24: Loss: 0.1349 Validation Accuracy: 0.902600 Epoch 164, CIFAR-10 Batch 25: Loss: 0.1537 Validation Accuracy: 0.903400 Epoch 164, CIFAR-10 Batch 26: Loss: 0.1308 Validation Accuracy: 0.903000 Epoch 164, CIFAR-10 Batch 27: Loss: 0.1162 Validation Accuracy: 0.902800 Epoch 164, CIFAR-10 Batch 28: Loss: 0.1921 Validation Accuracy: 0.901800 Epoch 164, CIFAR-10 Batch 29: Loss: 0.1496 Validation Accuracy: 0.901800 Epoch 164, CIFAR-10 Batch 30: Loss: 0.1353 Validation Accuracy: 0.903000 Epoch 164, CIFAR-10 Batch 31: Loss: 0.1316 Validation Accuracy: 0.902000 Epoch 164, CIFAR-10 Batch 32: Loss: 0.1340 Validation Accuracy: 0.902000 Epoch 164, CIFAR-10 Batch 33: Loss: 0.1608 Validation Accuracy: 0.901800 Epoch 164, CIFAR-10 Batch 34: Loss: 0.1592 Validation Accuracy: 0.902000 Epoch 164, CIFAR-10 Batch 35: Loss: 0.1591 Validation Accuracy: 0.901800 Epoch 164, CIFAR-10 Batch 36: Loss: 0.1937 Validation Accuracy: 0.902400 Epoch 164, CIFAR-10 Batch 37: Loss: 0.1431 Validation Accuracy: 0.902600 Epoch 164, CIFAR-10 Batch 38: Loss: 0.1179 Validation Accuracy: 0.901600 Epoch 164, CIFAR-10 Batch 39: Loss: 0.1223 Validation Accuracy: 0.902000 Epoch 164, CIFAR-10 Batch 40: Loss: 0.1517 Validation Accuracy: 0.902200 Epoch 164, CIFAR-10 Batch 41: Loss: 0.1250 Validation Accuracy: 0.901800 Epoch 164, CIFAR-10 Batch 42: Loss: 0.1385 Validation Accuracy: 0.902800 Epoch 164, CIFAR-10 Batch 43: Loss: 0.1432 Validation Accuracy: 0.902600 Epoch 164, CIFAR-10 Batch 44: Loss: 0.1218 Validation Accuracy: 0.903000 Epoch 164, CIFAR-10 Batch 45: Loss: 0.1171 Validation Accuracy: 0.903000 Epoch 164, CIFAR-10 Batch 46: Loss: 0.1214 Validation Accuracy: 0.902000 Epoch 164, CIFAR-10 Batch 47: Loss: 0.1311 Validation Accuracy: 0.902400 Epoch 164, CIFAR-10 Batch 48: Loss: 0.1283 Validation Accuracy: 0.901800 Epoch 164, CIFAR-10 Batch 49: Loss: 0.1550 Validation Accuracy: 0.901600 Epoch 164, CIFAR-10 Batch 50: Loss: 0.1348 Validation Accuracy: 0.901600
In [72]:
%matplotlib inline
%config InlineBackend.figure_format = 'retina'
import tensorflow as tf
import pickle
import random
# Set batch size if not already set
try:
if batch_size:
pass
except NameError:
batch_size = 64
save_model_path = './image_classification'
n_samples = 4
top_n_predictions = 3
def test_model():
"""
Test the saved model against the test dataset
"""
test_features, test_labels = pickle.load(open('preprocess_test.p', mode='rb'))
loaded_graph = tf.Graph()
with tf.Session(graph=loaded_graph) as sess:
# Load model
loader = tf.train.import_meta_graph(save_model_path + '.meta')
loader.restore(sess, save_model_path)
# Get Tensors from loaded model
loaded_x = loaded_graph.get_tensor_by_name('inputs/x:0')
loaded_y = loaded_graph.get_tensor_by_name('inputs/y:0')
loaded_keep_prob_1 = loaded_graph.get_tensor_by_name('inputs/keep_prob_1:0')
loaded_keep_prob_2 = loaded_graph.get_tensor_by_name('inputs/keep_prob_2:0')
loaded_logits = loaded_graph.get_tensor_by_name('logits/logits:0')
loaded_acc = loaded_graph.get_tensor_by_name('predictions/accuracy:0')
loaded_is_training = loaded_graph.get_tensor_by_name('inputs/is_training:0')
# Get accuracy in batches for memory limitations
test_batch_acc_total = 0
test_batch_count = 0
for test_feature_batch, test_label_batch in batch_features_labels(test_features, test_labels, batch_size):
test_batch_acc_total += sess.run(
loaded_acc,
feed_dict={loaded_x: test_feature_batch, loaded_y: test_label_batch, loaded_keep_prob_1: 1.0, loaded_keep_prob_2: 1.0,
loaded_is_training:False})
test_batch_count += 1
print('Testing Accuracy: {}\n'.format(test_batch_acc_total/test_batch_count))
# Print Random Samples
random_test_features, random_test_labels = tuple(zip(*random.sample(list(zip(test_features, test_labels)), n_samples)))
random_test_predictions = sess.run(
tf.nn.top_k(tf.nn.softmax(loaded_logits), top_n_predictions),
feed_dict={loaded_x: random_test_features, loaded_y: random_test_labels, loaded_keep_prob_1: 1.0, loaded_keep_prob_2: 1.0,
loaded_is_training:False})
display_image_predictions(random_test_features, random_test_labels, random_test_predictions)
test_model()
INFO:tensorflow:Restoring parameters from ./image_classification Testing Accuracy: 0.8981408227848101
The following method about running TensorBoards in Google Colab refer to this stackoverflow answer.¶
Get TensorBoard running in the background. (Inspired by this answer.)
In [ ]:
LOG_DIR = '' # set this to your directory of tenosorboard log files, eg.'./tmp/log'
get_ipython().system_raw(
'tensorboard --logdir {} --host 0.0.0.0 --port 6006 &'
.format(LOG_DIR)
)
In [ ]:
! curl http://localhost:6006
Download and unzip ngrok.
In [ ]:
! wget https://bin.equinox.io/c/4VmDzA7iaHb/ngrok-stable-linux-amd64.zip > /dev/null 2>&1
! unzip ngrok-stable-linux-amd64.zip > /dev/null 2>&1
Launch ngrok background process...
In [ ]:
get_ipython().system_raw('./ngrok http 6006 &')
...and retrieve public url. (Source)
In [ ]:
! curl -s http://localhost:4040/api/tunnels | python3 -c \
"import sys, json; print(json.load(sys.stdin)['tunnels'][0]['public_url'])"
If you run against ngrok rate limits, try to use localtunnel instead:
In [ ]:
# Install
! npm install -g localtunnel
In [ ]:
# Tunnel port 6006 (TensorBoard assumed running)
get_ipython().system_raw('lt --port 6006 >> url.txt 2>&1 &')
In [ ]:
# Get url
! cat url.txt
Bonus: let accuracy over 90%¶
優化 CNN 的方法¶
- 改善 Gradient Vanishing 問題：
- Xavier Initialization → He Initialization
- Batch Normalization
- Selu (Self-Normalizing ReLU, SNN)
- 讓 Dropout 比例不一：Differential Dropout
- 隨機打亂資料：Random Shuffling
- 考慮模型複雜度的懲罰值：L2 Regularization
- Learning rate decay
- NIN
- Data Augmentation
NIN (Network in Network) 主要有兩大改進¶
1. Mlpconv (multilayer perceptron convolution)¶
- 在 conv layers 中間加上多層的 fully connected layers。
- 實作上使用 1x1 conv (又稱 cascaded cross-channel pooling, CCCP)。
- 提高 conv layer 的非線性感知能力。
2. Global Average Pooling¶
- 對整個 feature map 取平均值，直接作為output layer的結果。
- 取代 fully connected layers ，大幅減少 parameters 。
使用 Tensorboard 視覺化的結果調整 Hyperparameters¶
1. Choosing Learning Rate¶
I make the learning rate decays over 81 epochs and 122 epochs down to 1/10 of the initial learning rate. So, at about 81th epoch, there is an abrupt increasing!
結果顯示當 learning rate 為 0.001 時，收斂最快，準確率也最高。而 learning rate decay 可以在模型學完粗略的部分之後，以更小的 learning rate 學習更到細膩的部份，可由圖中約 81 epoch 時的突然變化得知的確有效。
2. Choosing Batch Size¶
結果顯示當 batch size 對於模型的準確度影響不大。大的 batch size 因為一次看的資料多，學習穩定，不易產生訓練震盪，且訓練較快，但是比較占記憶體；小的 batch size 每次只看一小批資料，在訓練過程中較不穩定，且較不吃記憶體，卻需較久的時間。
權重分布¶
Data Augmentation¶
我使用 imgaug 這個 python package 做 data augmentation 。
我先將 5 份 batch data (10000 images/batch data) 做 random shuffling 並切出 90% 作為 train batch data (9000 images/train batch data) ，並將 5 份剩下的 10% 集合成 validation data (5000 images/validation data) ，再將 5 份 train batch data 做 data augmentation ，每張 image 擴增 9 份，總共多產生 5 份 augmentation train batch data (81000 images/aug train batch)。
最後將 train batch data 與 augmentation train batch data 合併成 100000 images/batch ，然後隨機切成 10 等份做為新的 train batch data ，餵入模型訓練。
而其中我所使用到的 data augmentation 方法如下表：
產生出的圖片如下所示：
Reference¶
《Network In Network》: https://arxiv.org/pdf/1312.4400.pdf
《Striving For Simplicity：The All Convolutional Net》: https://arxiv.org/pdf/1412.6806.pdf
NIN: https://github.com/BIGBALLON/Deep-learning-and-practices/tree/master/Lab3-NIN
Xavier Initialization: http://andyljones.tumblr.com/post/110998971763/an-explanation-of-xavier-initialization
《Self-Normalizing Neural Networks》: https://arxiv.org/pdf/1706.02515.pdf
